KAZHDAN-LUSZTIG POLYNOMIALS AND CHARACTER 
FORMULAE FOR THE LIE SUPERALGEBRA 0l(m|n) 

JONATHAN BRUNDAN 

Abstract. We compute the characters of the finite dimensional irreducible 
representations of the Lie superalgebra gl{m\n), and determine Ext's be- 
tween simple modules in the category of finite dimensional representations. 
We formulate conjectures for the analogous results in category O. The com- 
binatorics parallels the combinatorics of certain canonical bases over the Lie 
algebra 0[(oo). 



1. Introduction 



The problem of computing the characters of the finite dimensional irreducible 
representations of the Lie superalgebra Ql{m\n) over C was raised originally by 



V. Kac in 1977 [Ka2, Ka3|. Kac proved that the finite dimensional universal 
highest weight modules, known nowadays as Kac modules, are irreducible for 
so-called typical highest weights, and gave a formula for their characters. After 
that, there were several conjectures and partial results dealing with atypical 
highest weights |JHKT1| , |JHKT2| , pKj| , ^^aW| , before the 

complete solution to the problem was given by V. Serganova [p2|, |S3t in 1995 
using a mixture of algebraic and geometric techniques. 

In this article, we present a different, purely algebraic solution of the problem. 
One consequence is a proof of a conjecture made by van der Jeugt and Zhang 
[ [JZ| , which is apparently closely related to the conjectures made in | IIKJ| j. In 
particular the composition multiplicities of the Kac modules are all either or 1, 
a fact which does not seem to follow easily from Serganova's formula since that 
involves certain alternating sums. We also formulate for the first time a con- 
jecture for the characters of the infinite dimensional irreducible representations 
in the analogue of category O for the Lie superalgebra g[(m|n). 

Inspired by ideas of Lascoux, Leclerc and Thibon [|LLT[ , our approach is to 
relate the finite dimensional representation theory of Ql{m\n) to the structure 
of the module 

where 'Y denotes the natural representation of the quantized enveloping alge- 
bra C^<j(0(oo)- By work of Lusztig [Q, ch. 27], the module (^'"1" possesses a 
canonical basis {U\\ and a dual canonical basis {-^^a}) see Theorems |3.6| and 
3.13 , which for the purpose of this introduction we parametrize via ( [4. 41 ) by 
the set X^{m\n) of dominant integral weights for gl(m|n). The entries of the 
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transition matrices between these bases and the natural monomial basis {Kx} 
of define polynomials Ufj_^x{q) and lfj,,x{q) for each /U, A G X"*"(m|n): 

IJ,€X+{m\n) fj.eX+{m\n) 

The remarkable thing is that it is quite easy to compute these polynomials 
explicitly, because all the s[2-strings in the crystal graph underlying the module 
^m|n g^j^g q£ ig]2gth < 2, see Corollary 3.3i3| for the explicit formulae. The main 
result of the article shows that the polynomials Ufj_^x{q) evaluated at g = 1 



compute the composition multiplicities of the Kac modules, see Theorem 4.37 
and ( 4.39| ). Moreover, the polynomials l^,x{—Q~^) coincide with the Kazhdan- 



so can 



Lusztig polynomials Kx,^{q) defined originally by Serganova [ 
be used to compute Ext's between Kac modules and irreducible modules, see 



Theorem 4.51 and Corollary 4.52. 

The module (^'"l" is a summand of the tensor space 



The latter also possesses a canonical basis {Tx} and a dual canonical basis {-^^a}) 
see Theorems 2.17 and 2.23| , which we parametrize via ([4.4[) by the set X{m\n) 
of all integral weights for 0[(m|n). For A € X^(m\n) C X{m\n), the elements 
Lx here coincide with the images of the elements with the same name in the 
previous paragraph under the embedding (^"^1"- ^ >^m\n^ The entries of the 
transition matrices between these bases and the natural monomial basis {Mx} 
of give us polynomials t^^^xiQ) and l^^xiQ) for each /U, A G X{m\n): 

Tx= Yl Lx= Y 

fi^X{m\n) fi&X{m\n) 

These should be viewed as the true combinatorial analogues for g[(m|n) of the 
Kazhdan-Lusztig polynomials of |KL, Deo |. We explain an explicit algorithm to 
compute tn^xil) in |j2-j , and conjecture based on calculations with this algorithm 
that our polynomials share the positivity properties of the usual Kazhdan- 
Lusztig polynomials, see Conjecture 2.28 . We conjecture moreover that the 
polynomials tfj_^x{Q) evaluated at g = 1 compute the composition multiplicities 
of the Verma modules in category O, see Conjecture 4.32 and (4.34). This 
conjecture is true in the case m = by the original Kazhdan-Lusztig conjecture 



[KL| for the Lie algebra Ql{n) proved in |BE, BrK|, see Theorem 4.31| (i). 

Returning to finite dimensional representations, let us now formulate the 
conjecture of van der Jeugt and Zhang proved here precisely, to give the flavor 
of the combinatorics that arises. So let q denote the Lie superalgebra gl(m|n) 
over C, labeling rows and columns of matrices in q by the ordered index set 
I{m\n) = {—m, . . . , —1, 1, . . . , n}. We work always with the standard choices 
f) and b of Cartan and Borel subalgebras, consisting of diagonal and upper 
triangular matrices respectively. For i £ I{m\n), let 5i € f)* denote the function 
picking out the ith diagonal entry of a diagonal matrix. Put a symmetric 
bilinear form (.|.) on f)* by setting {Si\6j) = 1 if i = j > 0, — 1 if i = j < 0, and 
otherwise. Let W = Sm x Sn denote the Weyl group associated to qq, acting 



KAZHDAN-LUSZTIG POLYNOMIALS 



3 



naturally on f)*. We also need the dot action of on f)*: w ■ X = ■w{X + p) — p 
where p = - i6i. 

Let X[m\n) C f)* denote the set of all Z-linear combinations of the weights 
{<5i}ig/(m|ra)) ^nd let X~^{m\n) C X{m\n) denote the dominant integral weights, 
namely, the weights A = Yliiei(m\n) ^i^i ^ X{'m\n) with A_m > • • • > A_i, Ai > 
■ ■ ■ ^ A„. Associated to A G X"'"(m|n), we have the Kac module K{\) and its 



unique irreducible quotient L{\), see |§4-a. We should note that there is no loss 



of generality in restricting our attention to integral weights, since an arbitrary 
finite dimensional irreducible representation of 0[(m|n) is either typical or can be 
obtained from L{\) for some A G X^[m\n) by tensoring with a one dimensional 
representation. 

Main Theorem. Let A G X~^{m\n). Let r he maximal such that there exist 
—m < ii < • • • < ir < < jr < • • • < ji < n with (A + p\6i^ — 5jJ = for each 
s = 1, . . . , r. Let (ki, . . . , kr) be the lexicographically smallest tuple of strictly 
positive integers such that for all 9 = {0i, . . . , 6^) G {0, 1}'', A + Yl^s=i ^s^s^^is ~ 
5j^) is conjugate under the dot action of W to a dominant weight, denoted 
Re (A) G X~^{m\n). Then, for each p G X~^{m\n), 

I if p = Re(A) for some 6 = ((9i, . . . , 6*,.) G {0, l}^ 
otherwise. 



[K{f,) : L(A)] 



To prove the Main Theorem, we work with a different family of modules 
{U (X)} X(zx+ {m\n) called indecomposable tilting modules, following the general 
framework developed by Soergel po2| ] and extended to Lie superalgebras in 
[ P2| . The problem of computing the multiplicities of Kac modules in inde- 
composable tilting modules is roughly speaking transpose to the problem of 
computing the composition multiplicities of Kac modules, see ( 4.161) for the 



precise relationship (a twisted BGG reciprocity). The main step in the proof 
gives an explicit inductive construction of the C/(A)'s starting from the typical 
case, when U{X) = K(X), and applying certain special translation functors that 
arise from tensoring with the natural module and its dual. Actually, we see 
eventually that the indecomposable tilting modules in this finite dimensional 
setting coincide with the indecomposable projectives (also injectives), but they 
are parametrized by highest weight rather than by their irreducible quotients. 
Though one could just as well choose to work with the latter more familiar 
labeling, the alternate parameterization seems to be the one that emerges nat- 
urally when considering canonical bases. There are also indecomposable tilting 
modules denoted {T{X)}x^x{m\n) iii category O, where again they seem to cor- 
respond most directly to the canonical basis. 

We now explain how the remainder of the article is organized. In sections 
2 and 3, we give the construction and properties of the canonical bases of 
the modules ^'"l" and (o""^!" from a purely combinatorial standpoint. Then 
in section 4 we describe the representation theory of gl(m|n), working in two 
natural categories 0.m|n and J^rn\n whose Grothendieck groups are identified with 
the spaces ^'"l" and respectively. In sections 2 and 3 we work exclusively 
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in a p-shifted notation which is more convenient for the combinatorics, replacing 



the set X{m\n) of weights with the set of functions I{m\n) TL. See (4.4) 
for the rule to translate between the two notations. 

Acknowledgements. I would like to thank Arkady Berenstein and Jon 
Kujawa for helpful conversations, Barrie Hughes for pointing out the conjectures 
made in | HKJ| , p^ , and Nathan Geer for asking questions that pushed me to 



think about the results in 54-1- 



2. Tensor algebra 

In this section, we define and study the canonical basis of the tensor space 
a/-m\n ^ "We will work throughout over the field Q(q') of rational functions, where 
q is an indeterminate. 

§2-a. Combinatorial notation. For m, n > 0, let S^\^^ denote the symmetric 
group Sm X Sn acting on the set /(m|n) = {— m, . . . , —1, 1, . . . , n} so that Sm 
permutes {— m, . . . , —1} and 5„ permutes {!,..., n). Thus S^\^n is generated 
by the basic transpositions 

= (-"T. -m+1), . . . ,s_i = (-2 -l),si = (l 2), . . . ,s„_i = (n-1 n). 

Let Z™l" be the set of all functions /(m|n) Z. We call / G Z™'" antidominant 
if/(-m) > ••• > /(-I), /(I) < ••• < /(n). Note 5„|„ acts on the right on Z'^l'^ 
by composition of functions, and every / G Z™''" is conjugate under this action 
to a unique antidominant function. We also have the 'flip' cj : Z™!" — > Z"'!'", 
where w(/) is the function I{n\m) -^"L^i^ /(— i). 

Let P denote the free abelian group on basis {eq | a G Z} endowed with a 
symmetric bilinear form (., .) for which the Ea form an orthonormal basis. We 
view P as the integral weight lattice associated to the Lie algebra gl;,^. The 
simple roots are the elements Ea — Ca+i G P for a G Z. The dominance ordering 
on P is defined hy ^ < v \i [v — ^) is an N-linear combination of simple roots 
(here and later N = {0, 1,2,...}). Equivalently, ^ <v \i 

Y,{l^^^b)<Y.{y,eb) (2.1) 

b<a b<a 

for all a G Z with equality for a 3> 0. 
For / G Z"^!*^ and j G I{m\n), define 

wt(/) := Yl sgn(f)ej(j), wtj(/) := ^ sgn(i)ej(j), (2.2) 

where sgn(i) G {±1} denotes the sign of i. The degree of atypicality of / G Z™'" 
is defined to be 




Y.\{wt{aEa)\] . (2.3) 



m + n — 

aez / 
If #/ = 0, then / is called typical. So / is typical if and only if 

{/(-m),...,/(-l)}n{/(l),...,/(n)} = 0. 
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§2-b. Bruhat ordering. Introduce a partial ordering on Z™"'" by declaring 
that g ^ f if wt((7) = wt(/) and wtj{g) < wtj(/) for all j € I{m\n). It is 
immediate that if ^ / then = #/. Using (|2.1|), we see that g < f \i and 
only if 

Y sgn(i) < ^ sgn(i) (2.4) 

j<iG/(m|n) j<iG/(m|n) 
g{j)<a 

for all a G Z and j € /(m|n), with equality if either a ^ or j = —m. Prom 
this, one gets in particular that g < f ii and only if oj{g) ■< uj{f). In proofs, it 
will be convenient to have a shorthand for the sums appearing in the inequality 
(^, so for / G Z"^!", o G Z and j G I{m \n) we abbreviate 

W,a,j)= Yl sgn(«). 

j<«S/{m|n) 
f{i)<a 

Thus, g ^ f if and only if H^{g,a,j) < i^{f,a,j) for all a G Z and j G /(m|n), 
with equality for a ^ or j = —m. 

Here is another description of the partial order. Let di G Z*"!" be the function 
j I— > sgn(i)(5ij, for each i G I{m\n). Write / J, 5 if one of the following holds: 

(1) g = f — di + dj for some —m < i < —1,1 < j < n such that /(i) = /(j); 

(2) g = f ■ {i j) for some I < i < j < n such that /(i) > f{j); 

(3) g = f ■ {i j) for some — m < i < j < — 1 such that /(i) < /(j). 
Then: 

Lemma 2.5. f g if and only if there is a sequence hi, . . . ,hr G Z™'" suc/i 
i/iai / = /i;^ J, . . . I /i^ = 51. 

Proof. (<^=) Obvious. 

(=>) We show by induction on (m + n) that if f y g are neigbors in the 
ordering, then fig. The case m + n = is vacuous, so suppose m + n > 0. 
Replacing /, g by uj{f),uj{g) if necessary, we may assume in fact that n > 0. 
If f{n) = g{n), then we are done by induction, so we may assume that a = 
f{n) < g{n) = b. We consider two cases. 

Case one: there exists < i < n with a < f{i) < b. Pick the greatest such i, so 
each f{j) for j = i + 1, . . . ,n is either < a or > 6, and set c = f{i). We claim 
that f y f • {i n) g, whence f [ g as required since / and g are neighbors. 
Por i < j and a < d < c, we have that #(/ • (i n),d,j) = i^{f,d,j) — 1, 
while #(/ • {i n),d,j) = #{f,d,j) for all other j,d. Therefore to prove the 
claim, we just need to show that #{f,d,j) > ^{g,d,j) for each i < j and 
each a < d < c. But by the choice of i, we have that #{f,d,j) = i^{f,b,j) > 
#{g,b,j) > #{g,d,j) since g{n) = b. 

Case two: each f{j) for j = 1, . . . , n is either < a or > 6. Prom (wt{g),eb) = 
(wt(/),eb) < 0, we deduce that there must exist —m < i < with g{i) = b. 
Take the greatest such i. Now we claim that / >z g+di—dn >- g, so again f I g as 
they are neighbors. To prove the claim, note that ^{g+di — dn, d,j) = #(5, d,j) 
unless j > i and d = b—1, while 4^{g+di—dn, b—l,j) = #(5, 6— 1, j)+l for j > i. 
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Therefore we need to show that #{f,b — > #{g,b — for each j > i. 
Now observe that #{f,b-l,j)>#if,b,j)>#ig,b,j) > #(5, 6 - 1, j). □ 

For example, writing elements of Z^l^ as tuples, 

(1,2|2,1) i (1,2|1,2) i (1,3|1,3) i (3,1|1,3). 

It is worth pointing out that / € is minimal with respect to the ordering 

just defined if and only if / is typical and antidominant. 

§2-c. The quantum group. Recall that the quantum integer associated 
to n > is [n] := {q^ — q~"')/{q — q~^) and the quantum factorial is [n]! : = 
[n][n — 1] . . . [2][1]. Let — : Q{q) — > Q{q) be the field automorphism induced by 
q I— 5- q~^. We will call an additive map f : V W between Q{q)-vectoT spaces 
antilinear if f{cv) = cf{v) for all c E Q{q), v £ V. 

Let ^ denote the quantum group Ug{Ql^). By definition, this is the 
algebra on generators Ea, Fa, Ka, (a G Z) subject to relations 

KaK~^ = K~'Ka = 1, 
KaKh = KhKa, 

KaFhK-^ = q(^'^'^>'+i-^>')Fb, 

,a+l — Ka+l,a 



EaFb — Fi,Ea 



q-q 1 



EaEb = EhEa if \a-b\> 1, 

ElEb + EbEl = {q + q~^)EaEhEa if \a - b\ = 1, 

FaFb = FbFa if \a-b\> 1, 

F^Fb + FbF^ = {q + q-^)FaFtFa if \a - b\ = I. 

Here, for any a,b £ Z, Kafi denotes KaK^^ . Also introduce the divided powers 

Fa := Fa/[r\\ and Ea := -^^/[r]!. We have the bar involution on ^ , namely, 
the unique antilinear automorphism such that Ea = Ea,Fa = Fa,Ka = K~^. 

We regard as a Hopf algebra with comultiplication A : ^ ® 
defined on generators by 

A(K) = l®Ea + Ea® Ka+l,a, 
A{Fa) = Ka,a+1 ® + 1, 
A(K„) =Ka(S Ka. 



This is the comultiplication from Kashiwara [|K2| , and is different from the one 
in Lusztig's book Q. The counit e is defined by e{Ea) = £{Fa) = 0, e{Ka) = 1, 
the antipode S by S{Ea) = -EaKa,a+u S{Fa) = -Ka+i,aFa, S{Ka) = K-\ 

§2-d. The space Let T be the natural '^-module, with basis {vajaez 

and action defined by 

KaVb = q^'''''Vb, EaVb = 5a+l,bVa, FaVb = 5a,bVa+l- 
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Let W = 'y* be the dual ^-module, with basis {wa\a& related to the basis of 
'y by {wa,Vb) = {—q)~"'5a,b- The action of ^ onW satisfies 

KaWb = q~^''-''Wb, EaWb = 5a,bWa+l, FaWb = 5a+l,bWa- 

Let := W^"" (g) y®", viewed as a ^-module in the natural way. Recall 

that Z"*!" denotes the set of all functions I{m\n) Z. For / G Z"*!", we let 

M/ = Wf(^_m) ® Vf(i) • • • (g) 

The vectors {Mf} j:^^m\n give a basis for A vector w in a ^-module M 

is said to be of weight v £ P KaV = q^'^'^'^^v for all a G Z. The weight of the 
vector Mf is wt(/), as defined in ( ^.21) . 

We will often work with a completion ^^l*^ of ^'"1". To define this formally, 
let l^^l^ denote the set of all / € Z*"!" with f{i) < d for all i G I{m\n). Let 
=5^'" denote the subspace of spanned by {Mj} „m|n, and let 7r<d : 

(j^m\n denote projection along the basis. The filtration (kev TT<d)dez 

induces a topology on the abelian group j^'"!"^ see [ Bou , ch.III, §2.5]. Let 

= lim5'<"l" 

denote the corresponding completion, and identify with its image in 

^m\n^ The projections 7r<^ extend by continuity to give maps tt^^ ■ J^"*!" — > 
=5^'". As usual, we will view elements of as infinite Q(g)-linear combina- 

tions of the basis elements {Mj} j^^m\n whose projections onto each =^<^'" are 
finite sums. A homomorphism 9 : ^"-l" ^m\n q£ g^j^gijg^j^ groups satisfying 
the compatibility condition 

7r<rf(n) = implies 7r<d((9(n)) = for all u G =5^"^!" and alld:>0 

is automatically continuous, hence extends uniquely to a continuous endomor- 
phism of ^'"l"'. In particular, the action of lifts uniquely to a continuous 
action on ^'"l"^ since Ea,Fa and Ka commute with ir^d for all d> a. 

§2-e. The Iwahori-Hecke algebra. Associated to the symmetric group S^in 
we have the Iwahori-Hecke algebra rJ^rn\n- This is defined as the Q(g)-algebra 
on generators H^m+i, ■ ■ ■ , H-i,Hi, . . . , Hn-i subject to relations 

Hf = l-{q- q-')Hi, 
HiHi+iHi = Hi^iHiHij^i^ 
HiHj = HjHi if|i-j|>l. 

For X G S^^ni have the corresponding element G J^rn\ni where = 
Hi^ . . . Hi^ if X = Sj^ . . . Si^ is a reduced expression for x. The bar involution on 
J^rn\n is the Unique antilinear automorphism such that = H~-i , in particular 
7r, = Hi + {q-q~'). 
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We define a linear right action of ^rn\n o^i ^'"l" by the formulae 

MfHi={ q-^Mf iff = f-Si, 

( Mf.s^-{q-q-^)Mf if f y f ■ Si. 

Since the action of J^m\n commutes with all tt^i^, it lifts by continuity to 

As is well-known, see e.g. |D2|, the actions of ^ and J^m\n on ^'"l" commute 

with one another, hence the actions on the completion also commute. 

§2-f. Some (anti) automorphisms. Let (t,t : ^ — > be the antiautomor- 
phisms and uj : ^ ^ ^ he the automorphism defined by 

T{Ea) = q-^Ka+l,aFa, T{Fa) = qEaKa,a+l, r{Ka) = Ka, 

Uj{Ea) = Fa, Oj{Fa) = Ea, Uj{Ka) = 

Let r : — > '^m\n be the antiautomorphism and uj : M'rn\n ~^ •^n\m. be the 
isomorphism defined by T{Hi) = Hi and io{Hi) = H^i for i € I{m — l\n — 1). 
Introduce the linear map 

^.^m|n^^n|m^ ^ M^(^f), (2.6) 

where uj{f) is as in |§2-a . Note uj extends by continuity to a linear map — > 
^n\m^ Next let (., .)^ be the symmetric bilinear form on defined by 

iMf,Mg)^=6f,g (2.7) 

for f,g(z Z"^!". Finally, define an antilinear map 

a : ^'"l" ^ ^'"l", Mf ^ M^f. (2.8) 

The form (., .)^ and the map a do not extend to the completion. 

Lemma 2.9. (i) lo{XuH) = lo{X)lo{u)uj{H) for all X e '^,H e J^rn\n 
and u € 

(ii) {XuH,v)^ = {u,t{X)vt{H))^ for all X e '^,H e J^i^ and u,v e 

(iii) a{XuH) = T{a{X))a{u)H for all X e , H e and u G =3^"^!". 

Proof. These are all checked directly for To prove them for , one 

first checks that r and — oa are coalgebra automorphisms and w is a coalgebra 
antiautomorphism of Hence it suffices to check (i)-(iii) when m + n = 1. □ 

§2-g. Generation. We proceed to prove that is generated as a topolog- 

ical '^-module by the vectors Mf for typical f G Z™'". 

Lemma 2.10. Suppose that f G Z™'" and 1 < ii < ■ ■ ■ < ir < n are such 
that f{ii) = ■■■ = f{ir) = a + 1 and f{j) ^ a, a + 1 for all j G + 



g{js 
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1, . . . , n} — {ii, . . . , ir}. Let f be the function with f'{ii) = ■ ■ ■ = f'{ir) = a 
and f'{j) = f{j) for all j ^ h, . . . ,ir. Then, for any g ^ f, 

Proof Take g ^ f. Recall the definition of dj G Z™l" from p^. Note E^j'^ Mg 
is a linear combination of Mg/ 's where g' = g — dj^ — ■ ■ ■ — dj^ for ji < ■ ■ ■ < 
jr G I{m\n) such that 

a if js < 0, 
a + 1 if is > 0. 

Let us show that for such a g', we have that g' ^ /'. By (|2.4| ), we need to show 
that #(5', b,j) < #(/', 6, j) for all b £ Z and j G I{m\n). Since 5 ^ /, we know 
that #((7, j) < #(/, j)- So we are done except possibly for b = a. Suppose 
then that #{g\a,j) > #{f',a,j) for some j. Say ii,...,is < j < is+i, ...,ir 
and ji, ...,jt<j< jt+i, ■ ■ ■ ,jr- Then, 

#{f',aj)<#{g',a,j)=#{g,a,j) + {r-t)<#{f,a,j) + {r-t) 
= #(/', a, j) -{r-s) + {r-t) = #(/' , a, j) + s - t. 

Hence, we must have that s > t. This implies in particular that j > 0, and 
using this we get that 

#{g,a + l,j) >#{g',a,j) > #{f',a,j) = #{f,a + l,j), 

which is a contradiction. So indeed we must have that g' ^ /'. Finally suppose 
that g' = f. The assumption that /(j) a,a + 1 for j G {ii, zi + 1, . . . , n} — 
{ii, . . . ,ir} means that we must have ji < ii, . . . , jV < V- Hence, f ^ g. Since 
we started with the assumption that g ^ f, we therefore have g = f which 
completes the proof. □ 



Twisting with u) using Lemma |2.9| (i) , we also have the analogous statement 
for rt^: 

Lemma 2.11. Suppose that f G Z*"'" and —m < ir < ■ ■ ■ < ii < —1 are such 
that f{ii) = ■ ■ ■ = f{ir) = a + 1 and f{j) ^ a,a + 1 for all j G {—m, 1 — 
m, . . . ,ii} — {ii, . . . ,ir}. Let f be the function with f'{ii) = ■ ■ ■ = f'{ir) = a 
and f'{i) = f{j) for all j ^ ii, . . . ,ir- Then, for any g ^ f, 

F^'^Mg G 6f,gMf, + J2 nQ,Q'']Mg'. 

Theorem 2.12. We can write each Mf as a (possibly infinite) Z[q,q^^]-linear 
combination of terms of 
1 and typical g G Z*"!". 

Proof. To prove the theorem, it suffices to show for each d £ T, and / G Z"^'" 
that we can write Mf as a finite linear combination of terms of the form 
F^l^K . . F^l"^ Mg for typical g G Z™l" modulo ker7r<d. So fix d G Z and 



combination of terms of the form Fa-^ . . . Fa/ Mg forai, . . . ,as G Z,ri, . . . > 
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/ G There are only finitely many g ^ f with n^^Mg ^ 0, So pro- 

ceeding by induction on the dominance ordering, we may assume that every 
Mg with g < f can be expressed as a finite linear combination of terms of the 
form F^l^^ . . . F^l'^'Mg for typical 5 G Z""!" modulo ker 7r<rf. 

Let {ai < a2 < ■ ■ ■ < as] = {/(-m), . . . , /(-I)} and let rj = #{i G 
/(m|0) I f{i) = at] for each t = l,...,s. Choose /c » so that every ele- 
ment of the set {/(— m) + A;, . . . , /(—I) + A;} exceeds every element of the set 
Define 5 e by 

^ I + ifz<0. 
Note g is typical by the choice of k. Now consider 

-^as ■ ■ ■ ^ as+k~l^ as-i ' ■ ■ ^ a^-i+k-l ' ■ ■ ^ ai ■ ■ ■ ai+k-V^^9 ■ 



One checks using Lemma 2.11 that this equals Mj plus a q ^]-linear com- 



bination of M^s with h ~< f . So we are done by the induction hypothesis. □ 

Corollary 2.13. Suppose 9 : a;^m\n ^ continuous , J^mln-birnodule 

endomorphism fixing Mf for all typical antidominant f G Z™"'". Then 9 is the 
identity map. 

Proof. If / is antidominant, then MfHx = Mj.^ for all x G S^^n. So for typical 
antidominant / we have that 9{Mf.x) = 9{MfHx) = 9{Mf)Hx = MfH^ = 
Mf.x. This shows that 9 fixes Mg for all typical g G Z™''"'. Now using the con- 



tinuity of 9 and Theorem 2.12 , we get that 9 fixes all Mj. Hence by continuity 



again, 9 is the identity map. □ 

§2-h. Canonical bases. We now follow ideas of Lusztig ch. 27] to define a 
canonical topological basis of ^"^1*^. We should note that in loc. cit., Lusztig 
only considers finite dimensional quantum groups, but the techniques generalize 
to our situation on passing to the completion. The first step in the construction 
is to introduce a bar involution on the space ^'"l" that is compatible with the 
bar involutions on ^ and on The definition of this in Lusztig's work 

involves the quasi- i?-matrix associated to . One gets from 1^, §27.3] a bar 
involution — : ^m\n ^i^g^^ satisfies property (iv), hence (i), in the 

theorem below and that is compatible with the bar involution on . One 
then checks easily using Lusztig's definition that it is also compatible with the 
bar involution on J^rn\m giving the existence half of the proof of the theorem. 

We will sketch a direct construction of the bar involution on ^"^l" below, 
independent of Lusztig's work. 

Theorem 2.14. There exists a unique continuous, antilinear map — : 
^""1" such that 

(i) Mf = Mf for all typical antidominant f G Z™'"; 

(ii) = XuH for allX e'2^,u£ H e je„ 
Moreover, 



mln ■ 
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(iii) bar is an involution; 

(iv) Mf = Mf + (*) where (*) is a (possibly infinite) Z[q, q~^]-linear combi- 
nation of Mg 's for g < f ; 

(v) ZAu) = u{u) for all u e ^'"l". 

Proof. Let us first explain how to prove the uniqueness, and also the fact that 
bar is necessarily an involution. Suppose that we are given two continuous 
antilinear maps — ,~: ^'"l" — > ^"m-W satisfying properties (i) and (ii). Then 
we can consider the composite map 

This is a continuous .y^|„-bimodule endomorphism of ^'"l" fixing Mf for 
all typical, antidominant /. Hence, ip is the identity map by Corollary 2.13| . 
In particular, this gives that u = u and u = u for each u £ Finally, 
applying ~ to both sides of the equation u = u gives that u = u for all u, 
whence uniqueness. 

To get existence without appealing directly to Lusztig's work, we need a little 
more notation. For a partition A = (Ai > A2 > . . . ), let |A| denote the sum of 
its parts, r(A) denote the total number of non-zero parts, and rs{X) denote the 
total number of parts equal to s. Also let 

p(A) = (1 - q^YW{-q)-W Yl /^W('-=W-l)/2[r,(A)]!. 

S>1 

Finally, for a G Z and a partition A, let a^'" G Z™'" denote the function 
i H-» a + A|j|. Let /J™'"' denote the set of minimal length stab5^|^ (a™'"')\S'^|„- 
coset representatives. For example, if A = (2, 1, 1), then 

M 3|2 = Wl Wl ® W2 ® V2 ^ Vi, 
3 1 2 

-^A = ■S-l, ■5_lS_2, Si, S_iSi, S_iS_2Sl}. 

Now define _ : ^"^1" ^ to be the unique antilinear map satisfying the 

following properties: 



_ j-~,7n\n 



(Bl) For a G Z, w^"" ® vT = P(^^ 

A with ^ ^ 

r(A)<m,n ^ ^ 

(B2) If a; G 5'm|n is the unique element of minimal length such that / • x is 

antidominant then Mf = Mf.xH~^. 
(B3) If all elements of {/(— m), . . . , f{—k — 1), /(/ + 1), . . . , f{n)} are strictly 

greater than all elements of {/(—A;), . . . , /(—I), /(I), . . . , f{l)} for some 

1 < k < m,l < I < n, then 

Mf= ^ agbhWg{^k-m) ® ■ ■ ■ O Wg(^_i) ®Mh® Vg^i) <g) • • • (g) fg(„_i) 

gdl {m—k\n—l) 
hel{k\l) 
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where 

g67(r?i— A;|n— /) 

U7/(_fc) • • • (g) (g) • • • (g) f = ^ 

/ie/(fc|z) 

The following property is a consequence of (Bl), and is useful in inductive 
arguments. We omit the proof. 

(Bl)' For m,n> and a G Z, 



^(m-l) <S>(n-l) 

^—qj Wa+l W u' 

(>1 

where X = 1 + qH-\ + • • • + . . . H^^ . 

For example: 



UJa — UJg^ , Ua — Uij^ , 

Wa Ig) -Ua = "gl -Va + (g - Q^"^) y^(-g)^~'wa+; (g) Va+«. 

/>1 

Now one checks easily that the map — : ^'"l"- — > j^gt defined satisfies 

(iv), hence (i), and (v). In particular, (iv) implies that bar is continuous, so it 
extends uniquely to a continuous antilinear map — : 

^m\n _^ grvn\n_ Que finally 
needs to show that it satisfies (ii) . This is done by a lengthy - but elementary - 
verification, using (Bl), (Bl)', (B2) and (B3) directly. We omit the details. □ 



Now we appeal to the following general lemma originating in [KL|, also used 
implicitly in IQ, §27.3]. See |D1, 1.2] for a short proof. 

Lemma 2.15. Let (/, ^) he a partially ordered set with the property that {j G 
I \ j ^0 finite for all i € I. Suppose that M is a Q{q)-vector space with 
basis {ui}i£i equipped with an antilinear involution — : M ^ M such that 
Ui = Ui + (*) for each i £ I, where (*) is a 7j[q, q~^]-linear combination of uj 's 
for j -< i. Then there exist unique bases {xjjjg/, {yi}iei for M such that 

(i) xj = and Yi = Hi,' 

(ii) Xi £Ui + ^j(ziq'^[q]uj and yi £Ui + J2jei l^'^'^il'^'^'^J' 

for each i £ I. Moreover, the coefficient of Uj in Xi (resp. yi) is zero unless 
j ^ i- 

Applying this to the space ■^^}^ for fixed d G Z, the basis {MA m\n and 
the antilinear involution 7r<^ o — : ^y^'"" ^<d^ ^ deduce: 

Lemma 2.16. There exist unique bases {Tf^} ^m\n, {L^f*} m,\n for .^^'^ 
such that 
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(i) 7:<d{Tf) = Tf^ and ^<d{Lf) = if; 

(ii) eMf + Y: ^^rawq'L[q]Mg and if eMf + Y^ ^^n.inq-^Z[q-^]Mg. 
Moreover, the coefficient of Mg in Tj^^ (resp. ) is zero unless g ^ f . 

Passing to the completion gives us bases for ^'"l": 

Theorem 2.17. There exist unique topological bases {T/jjg^min, {L j} j^2^m\n 
for ^'"l" such that 

(i) Tf = Tf and Lf = Lf, 

(ii) TfeMf + EgeZr^lr^qmMg and Lf e Mf + %^^^wq-^nq-^]My. 
Moreover, 

(iii) Tf = Mf + (*) and Lf = Mf + (**) where (*) and (**) are (possibly 
infinite) linear combinations of Mg 's for g -< f; 

(iv) Lo{Tf) = T^^f) and io{Lf) = L^^fy 

Proof. Take e > d and / G ^<^"' Consider the elements Tj^'^ G Ji^^^"' and 
Tj'^^ S '^^<d'" given by Lemma |2.16| . We know that if 7r<rf(u) = then TT<cd{u) = 
0. Hence we have that TT<d{'^<d{u) — n) = for all u € ^"^l". Applying this to 
u = Tjr^'^ we deduce that 7^<d{T^<d{Tf^^)) = 'K<d{Tf^)- Hence by the uniqueness 
in Lemma 2.16, we have that 7:<:d{T^^^) = T^'^\ Similarly, 7r<rf(Ly^^) = L^^p. 
Hence, for all / G Z™!" there exist unique elements Tf,Lf € such that 

7r<d{Tf)=Tf\ TT<d{Lf) = Lf 

for all d G Z and all / G ^<i"- Using the lemma for each d € Z, one now easily 
checks that these satisfy (i)-(iii) , while (iv) follows from Theorem |2.14| (v) . □ 

We call the basis {7/}/gzm|n the canonical basis of ^'"l", and {Lf}f^im\n is 
the dual canonical basis. Let us introduce notation for the coefficients: let 

Tf= hjilWg, Lf= kfilWg (2.18) 

for polynomials tgf{q) £ Z[q] and lg.f{q) G We know that tgj{q) = 

^gjil) = unless g ^ f, and that tfj{q) = lfj{q) = 1- 

Example 2.19. If m = n = 1, the bases {Tf} f^j^m\n and {Lf} f^j^m\n are 

{Wa (g) ffe I a, 6 G Z, a / 6} U {Wa ®Va + qwa+i Va+i I a G Z}, 

{wa <S)Vb\a,b eZ,a^b}U {Wa <S) Va - q'^Wa+l Va+l 

+ q~'^Wa+2 Va+2 - ■■■ | a G Z} 

respectively. 
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|s2-i. Duality. We wish next to explain the relationship between the bases 



{Tjljg^min and Recall the definitions (2/7) and (|2.8| ). Define a 

new bilinear form (., .)^ on by 

= (n,a(l;)),^ (2.20) 

for u, w G Note this makes sense, even though the expression (t(1J) may 

not make sense in its own right. Indeed, it is clear that on expanding u and 
V in terms of the basis {Mj}, there are only finitely many / such that Mf is 
involved in u and M_j is involved in v. So we can interpret {u,a{v))^ as 

all but finitely many terms in the sum being zero. 

Lemma 2.21. {XuH,v)^ = {u,a{X)vT{H))^ for all X £'^,H e M'rn\n and 
u,v e 3-Mr\ 

Proof. According to Lemma |2.9| , we have that 

{XuH,v)^ = {XuH,a{v)y^ = {u,T{X)a{v)T{H))^ 



= {u,T{a{a{X)))<j{v)T{H))^ = {u,<j{a{X)vT{H)))^ 
= {u,a{a{X)vTiH)))^ = {u,a{X)vT{H)) ^ . 

□ 

Lemma 2.22. The bilinear form i-,.)^ is symmetric. 

Proof. Let us first show that {u, Mf)^ = {Mf,u)^ for all u G 5^™!" and typical 
antidominant / G Z™'". We need to show that {u,M^f)^ = {u, M_f)^, for 
which it suffices to consider the special case u = Mg. Then, {Mg, M^f)^ = 
5g-f. Consider {Mg, M^j)^ . By Theorem 2.14| (iv), it is zero unless wt{g) = 



wt(— /). So since — / is typical, g must be too. By Theorem 2.14 (iv), 

Mg = Mg + (a linear combination of M/j's with h ~< g). 

Since / is antidominant, we deduce that {Mg, M^j)^ = {Mg, M^f)^ = Sg-f. 

Now we show that {u,Mf)^ = {Mf,u)^ for all u G j^"^!" and all typical 
/ G Z*"!". Let X G Sm\n be of minimal length such that f ■ x is antidominant. 



Then, by the previous paragraph and Lemma |2.21 , we have that 



{u,Mf)^ = {u,Mf.^T^-i)^ = {uT^,Mf.^)^ 

= {Mf.^,uT^)^ = {Mf.^T^-i,u)^ = {Mf,u)^, 

as required. 



Now let us consider the general case. In view of Theorem p.l2| , we may 
assume that v = XMg for typical g and X = . . . F^l"^ G . Then, by the 



previous paragraph and Lemma |2.21| , we have that 

{u,v)^ = {u,XMg)^ = {a{X)u,Mg)^ 

= {Mg,a{X)u)^ = {XMg,u)^ = {v,u)^. 
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This completes the proof. □ 

The following theorem characterizes {Lf} j^j^m\n uniquely as the dual basis 
to {T-g}g^^m\n uuder the bilinear form (.,.)^. 

Theorem 2.23. For f,ge {Lf,T^g)^ = 6f^g. 

Proof. Consider {Lf,T-g)^ = {Lf,a(T-g))^. We observe that -^^/ is equal to 
Mf plus a g~^Z[g'~^]-linear combination of M^s with h ^ f. Also a{T-g) equals 
Mg plus a g~"'^Z[q~^]-linear combination of M^s with h ^ g. Hence, {Lf,T^g)^ 
is zero unless / ^ 5, it is 1 if / = 5 and it is in q~'^'L[q''^\ if f y g. 

On the other hand, by Lemma 2.22| , {Lf,T^g)^ = {a{Lf),T^g)^. Hence, 



arguing as in the previous paragraph, {Lf,T^g)^ is zero unless / ^ 5, it is 1 if 
f = g and it is in qZ[q] if f >- g. Since q'^[q] fl q^^ljlq^^] = {0}, this completes 
the proof. □ 

Corollary 2.24. For f G Z"^!", 

Proof. By the theorem, we can write Mf = ^g^im\n {Mf,T^g)^Lg. Now a com- 
putation from the definition ( p. 201 ) of the form (., gives that {Mf,T-g)^ = 
t^f^^g{q^^). The second equality is proved similarly. □ 

§2-j. An algorithm. The goal in this subsection is to explain an algorithm 



to compute tI'^^ (cf. Lemma 2.16| ) for each d S Z and / G ^<j7- Assuming 



a certain positivity conjecture which ensures that the T^'^^ converge to Ty in 
finitely many steps, the algorithm can be modified to actually compute the 
canonical basis elements Tj themselves. 

The algorithm proceeds by induction on the degree of atypicality ^f of /. 
To begin with, we describe the base of the induction by explaining how to 
compute Tf (hence all Tj*^^) for typical f. If / is typical and antidominant, 
then we have that Tf = Mf and we are done. Otherwise, we can find i € 
I{m — l|n — 1) such that f • Si ^ f. We may assume by induction that Tf.g^ is 
already known, and consider the bar invariant element Tf.s^{Hi + q), which we 
view as a first approximation to Tf. It equals Mf plus a sum of terms pgj{q)Mg 
for polynomials Pgj{q) S Z[g] and g with g ~< f (there being only finitely many 
such g's since / is typical). For each such g with Pgj{0) 7^ 0, we make a 
correction by subtracting pgj(0)Tg from our first approximation. The result 
is a bar invariant expression that equals Mf plus a gZ[g]-linear combination of 
Mg's. This must be Tf by the uniqueness in Theorem |2.17 . 



We have just described the usual algorithm to compute the parabolic Kazhdan- 
Lusztig polynomials associated to the Hecke algebra J^rn\n pec 



To 



make this precise, let us recall the definition of the latter, following [3ol|. Let 
/ G Z™l" be antidominant. Then, Sf := stab5^|^(/) is a parabolic subgroup 
of 5m|n- Let Jff be the corresponding parabolic subalgebra of J^m\n- Let 1^^^ 
denote the one dimensional right Jiff -module on basis 1 with action IHi = q^^l 
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for each Hi G M'f. We consider the induced module 1,^^ ® ■^m\n- This has a 

basis given by the elements Mx ■= l^H^ as x runs over the set Dj of minimal 
length S f\Sm\n-(^oset representatives. The bar involution on l^j. '^m\n is 
the antilinear map defined by 1 (8) := 1 (g) H^- The Kazhdan-Lusztig basis of 
Ij^/ <^^/ '^m\n is the unique bar invariant basis {Ci /xgd^^ such that 

The corresponding parabolic Kazhdan-Lusztig polynomials are defined from 

ydD; 

The relationship to our situation is as follows: 

Lemma 2.25. Suppose that f is typical and antidominant. Then, for x G Df 
and g e Z*"!", 

my,i{q) if g = f ■ y for some y e Df, 
otherwise. 



Proof. Note that MjHi = q ^Mf for all Hi € J^j. So we get from Probenius 
reciprocity a unique J^|„-module homomorphism 9 : l^j. (g) J^m\n ~^ 
under which M^'^^ maps to Mf.^. By (B2) from the proof of Theorem |2.14| , 

= M/^. So (9(m) = 6'(u) for each n G 1 (g).^^ ^|n- Therefore, 9{cP) 

is bar invariant, and it equals Mf.^ plus a [5] -linear combination of other 
( f) 

Mg's. Hence, e{C^") = Tf.^ by the uniqueness. This shows that for each 

X G Df, 

y&D; 

The lemma follows. □ 

Remark 2.26. In the case m = 0, this lemma shows that in type A the 
parabolic Kazhdan-Lusztig polynomials coincide with the coefficients of the 
canonical basis of Y®^. This is a well-known observation, see for example 
[|KK|. 

Now we describe the algorithm to compute Tj*^^ for atypical /. We assume 

therefore that we are given d G Z and / G with #/ > 0, and that we have 

already constructed an algorithm to compute Tg for each e G Z and g with 
#5 < #/. Let us write /_ = (/(-m), . . . , /(-I)) and /+ = (/(I), . . . , f{n)). 
Define ai to be the greatest integer that appears in both the tuples /_ and /+. 
Now we iterate a certain humping procedure: 

Let ni^i be the number of entries equal to ai appearing in the tuple /+, and 
label all such entries. If there are no entries equal to (ai + 1) appearing to the 
right of labeled ai's, move on to the next paragraph. Otherwise, let ni^2 be the 
number of entries equal to (ai + 1) appearing to the right of labeled ai's, and 
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label all such (oi + l)'s. Next, if there are no (oi + 2)'s to the right of labeled 
(ai + l)'s, move on to the next paragraph. Otherwise let ni^s be the number 
of (ai + 2)'s to the right of labeled (ai + l)'s, and label all such (ai + 2)'s. 
Continue in this way. 

When the process just described terminates, we are left with a sequence 
^^1,1) ''^1,21 • • • jiT-i^ki for some ki > 1, where there are ni^i labeled {ai + i — l)'s 

in the tuple /+. We define Xi := -E'^^^^^^'Li • • • -£'i"+i^-E'a?^'^^ and a2 := ai + ki. 
If there are no entries equal to 02 in the tuple /_, the bumping procedure is 
finished. Otherwise, we need to repeat the bumping procedure but applied to 
/_ instead, as follows. Let 712,1 be the number of entries equal to 02 appearing 
in the tuple /_, and label all such entries. If there are no entries equal to 
(02 + 1) appearing to the left of labeled 02 's, move on to the next paragraph. 
Otherwise, let n2,2 be the number of entries equal to (02 + 1) appearing to the 
left of labeled 02 's, and label all such (02 + l)'s. Continue in this way until the 
process terminates. 

We are left with a sequence n2,i, n2,2j ■ ■ ■ , n2,ki for some k2 > 1, where there 

are n2,i labeled (a2+i-l)'s in the tuple /_. Let X2 := • • • i^^^i Vi"^'^) 

and := a2 + k2- This time if there are no entries equal to 03 in the tuple /+, 
the bumping procedure is finished. Otherwise, we repeat the whole process once 
more from the beginning, but using 03 in place of ai, to construct X3, 04, X4, . . . 
and so on. 

When the bumping procedure finally ends, we are left with a sequence of 
monomials Xi,...,X7v and integers oi < 02 < • • • < flAf+i- Increase all 
labeled entries in the tuples /-,/+ by 1 and let h G Z"^!*^ be the corre- 
sponding function. Note that #h < So by induction, we can com- 
pute tI^^\ where e = max((i, a^v+i)- Now consider the bar invariant element 
iTKdiXN ■ ■ ■ XiT^^^) G which is our first approximation to T^'^\ By 

it equals Mj plus a finite linear combination of terms 

Pgj{q)Mg for polynomials Pgj{q) € Z[g, q~^] and g S Z<^" with g ~< f. Now we 
make corrections to the first approximation. Let g ~< f he maximal such that 
PgjiQ) ^ Q'^Iq]- Let p'g j{q) be the unique bar invariant element of Z[q, q~^] such 
that p'g j{q) = Pgj{q) (mod qljlq]). Proceeding by induction on the ordering 

on Z<^", we may assume that T^^^ is already known. Subtract p'^ j{q)Tg'^^ from 

the first approximation, to obtain a second approximation to t'j^\ Repeating 
the correction procedure, we reduce in finitely many steps to a bar invariant 
expression that equals Mj plus a gZ[g]-linear combination of M^'s. This must 

be rj"^^ by the uniqueness. We are done. 

Example 2.27. We explain how to compute ^(^0411023) using the algorithm. 
The bumping procedure proceeds as follows: 

(0,4,1|0,2,3) (0,4,1|0,2,3) (0, 4, 1|0, 2, 3) 



Lemmas |2.10 and 2.11 
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Now, (0, 5, 2|1, 3, 4) is typical, so we can compute 7r<4(F4£^3£^2-P'i-Eor^Q ^ 2|i 3 4))) 
using the Kazhdan-Lusztig algorithm. It turns out that this equals Af(o,4,i|o,2,3) + 
M(i 4 2,3) plus a gZ[g]-linear combination of lower terms. Now one com- 
putes r^^^^^ i|i 2 3) needed for the correction procedure by repeating the algorithm 
(which is rather lengthy). Finally one obtains 

^(0,4,110,2,3) = ^(0,4,1|0,2,3) + qM^lA,0\0,2,3) + 9^(4,0,1|0,2,3) 

+ 9^-^(1,4,111,2,3) + Q'^Af(4,l,0l0,2,3) + 9^Af(4,l,l|l,2,3) • 

Note there is no reason why we chose to start the bumping procedure with /+ 
in describing the algorithm. One could also start the bumping procedure with 
/_ , increasing all entries in /_ equal to ai by 1 and so on ... . In practice, 
one should always choose to start with the side for which the resulting word 
Xn . . . Xi G ^ is as short as possible. In the present example, it is better to 
start the bumping procedure with /_, since then there is only one step: 

(0,4,1|0,2,3) "-i^°(0,4,l|0,2,3). 

Thus, we need to compute 7r<4(-Pbr(i 4 i|o 2 3)) instead, which is much quicker 
as only one generator of ^ needs to be applied. It turns out that this equals 
'^(o'4i|i2 3) directly (indeed it already equals T|o,4,i| 1,2,3))) with no corrections 
needed. 

Computer calculations using the above algorithm support the following pos- 
itivity conjecture: 

Conjecture 2.28. Let f G Z"^l". 

(i) The coefficients tgj{q) of Tf when expanded in the basis {^g\g^jm\n 
belong to N[g]. 

(ii) The coefficients lgj{q) of Lf when expanded in the basis {Mg}g^.^m\n 
belong to N[— 

(iii) For each a e Z, f e and r > 1, the coefficients of E^a^Tf and 
Fa^^Tf when expanded in the basis {Tg}g^^m\n belong to N[q,q~^]. 

(iv) For each a E Z, f e Z"*'" and r > 1, the coefficients of E^^Lf and 
Fa^Lf when expanded in the basis {Lg}g^jm.\n belong to ^[q^q^^]. 

If this positivity conjecture is true, it follows in particular that each Tf be- 
longs to ^"^1™ rather than the completion ,^'"An_ i,c. each Tf is a finite linear 
combination of M^'s. To see this, we modify the above algorithm to obtain 
an algorithm that computes Tf itself (not just the rj'^^'s) in finitely many 
steps, as follows. To start with, one follows the bumping procedure to obtain 
h and the elements X\, . . . ,Xn G ^ exactly as above. Since #/i < #/, we 
may assume that T^ is known inductively and is a finite sum of M^'s. Con- 
sider Xn ■ ■ ■ XiTh G ^m|n^ gj^^ choose e to be minimal so that X^ . . . XiT^ G 
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jJ^'". In view of Conjecture 2.28| (iii), Xn ■ ■ ■ XiT^ equals Tj plus a N[g, q 
linear combination of T^'s. So by Conjecture 2.28| (i), we must have that that 
Tf € ^^^"^ , hence Tf = Tj'\ Now follow the above algorithm to compute Tj'^ 

§2-k. Crystal structures. Finally in this section, we review some results of 
Kashiwara, see e.g. [K2[ for the basic language used here. Let £/ be the subring 
of Q{q) consisting of rational functions having no pole at q = 0. Evaluation at 
q = induces an isomorphism £/ jq-s^ Q. 

Let 7^ be the i2/-lattice in spanned by the Va's, and let #^ be the s^- 
lattice in spanned by the Wa's. Then, "V^^ together with the basis of the 
Q- vector space / q'f.s^ given by the images of the VaS is a lower crystal basis 
for at q = in the sense of [lK2| , 4.1]. Similarly, together with the 
basis for W^/qW^i/ given by the images of the WaS is a lower crystal basis for 
W at q = 0. Let ^'j'" = /T®'" r®" be the i^-lattice in spanned 
by the Mj's. Then, by p^2| . Theorem 4.1], t^J^'" together with the basis for 
^^^'^ / q^^^"" given by the images of the Mf for / € Z"^'*^ is a lower crystal 
basis for ^'"l"' at g = 0. Moreover, we can easily describe the associated crystal 
graph using Kashiwara's tensor product rule. 

To do this, let us identify the set {Af/ + g.^^'"}jg2m|n underlying the crystal 

basis with the set Z*"'" in the obvious way. Then, Kashiwara's crystal operators 
induce maps E'^, : Z'^''^ Z™!" U {0}. (We are using E'^, F^ because Ea, Fa 
are used for something else later on.) Fix a S Z and / € Z™!". The a-signature 
(cr_m, . . . , o-_i, cJi, . . . , o-„) of / is defined by 

{+ if i > and /(i) = a, or if i < and f{i) = a + 1, 
- if i > and f{i) = a + 1, or if i < and f{i) = a, (2.29) 
otherwise. 

From this, we form the reduced a-signature by successively replacing subse- 
quences of the form +— (possibly separated by O's) in the signature with 00 
until no — appears to the right of a +. Recall the definition of dj € Z*"'" from 
§2-4 We define 

E'aif) - 

and 

FLif) - 
Also let 

£;,(/) =max{r>0|(^;)^(/)/0} 

= the total number of — 's in the reduced a-signature, 

(/.;,(/) =max{r>0|(F^)^X/)/0} 

= the total number of +'s in the reduced a-signature. 



if there are no — 's in the reduced a-signature, 

/ — dj if the rightmost — is in position j E I{m\n), 

if there are no -|-'s in the reduced a-signature, 

/ -|- dj if the leftmost -|- is in position j £ I{m\n). 
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Then, the datum (Z™!", E'^, F^, e'^, (f'^, wt) is the crystal associated to the mod- 
ule =^""1". 

Example 2.30. Consider the function / = (3, 6, 2, 0, 2, 1|3, 2, 1) G Z^l^. The 
2-signature is (+, 0, — , 0, — , 0| — , +, 0). Cancelling off H — pairs, we deduce that 
the reduced 2-signature is (0, 0, 0, 0, — , 0| — , +, 0). Hence, the 2-string through 
/ in the crystal graph is 

(3, 6, 2, 0, 3, 1|2, 2, 1) (3, 6, 2, 0, 2, 1|2, 2, 1) ^ (3, 6, 2, 0, 2, 1|3, 2, 1) 

^ (3,6,2,0,2,113,3,1). 

Theorem 2.31. Let f G and a G Z. 

(i) EaTf = [(Paif) + + EgGZ-l"^g,/^9 ^^^re the coefficient u'^j 
belongs to q'^"^'^^s)z[q] and is zero unless s'^^{g) > £;,(/) for all 6 G 

(ii) FaTf = [e'^U) + 1]7>^(/) + Eggz-l"^g,/^9 ^^ere i/ie coefficient v'^j 
belongs to q^~''^''^^^TL\q\ and is zero unless f'l^ig) > f'bif) for all b (zT^. 

(In (i) resp. (ii), the first term on the right hand side should be omitted if E'ij^{f) 
resp. Faif) ^iuals 0.) 

Proof. Fix d ^ Wj, and consider ^ = ^^}^ , which is an integrable module in 



the sense of [|K1| , 1.3] with respect to the subalgebra of generated by all 
Ea,Fa,K^^ for a < d,b < d. Let % (resp. 5q) be the ^ (resp. Q[q,q~^]) - 
lattice in ^7 spanned by the basis elements {Mj} m|n. Let = T^<d{-%)^ an 

£^-\dXi\ce in ,^ . The canonical map =5^nj3^n=%o — ^ is an isomorphism; 

this follows at once from Lemma ^.16| since that shows that all three lattices 
are generated by the elements {tI } m|n. The preimage of the crystal basis 

element Mj + q^Q is Tjf'\ for each / G Z<j;"- In the language of Kashiwara 



[Kl|, this shows that (^, ^oo) is a balanced triple, and that {Ti^^} 

J J tz^. 



m n 



is a lower global crystal basis for ^ at q = 0. 



Now we get from |K1, Proposition 5.3.1] (which is about upper global crystal 



bases) and an argument involving duality ]|K1| , §3.2], that 



where the coefficient ^ belongs to q^ '^''(^^^[g] and is zero unless e'^(g) > £;,(/) 
for all b < d. Taking the limit as d — > oo, we get (i). The proof of (ii) is 
similar. □ 

We will also meet certain dual crystal operators on Z"*!". Define 

Kif) ■■= -FU-A-f), Kif) ■■= -EU^ai-f), (2.32) 
<(/) := ^'_i_,(-/), ^:(/) := (2-33) 



KAZHDAN-LUSZTIG POLYNOMIALS 



21 



These can be described explicitly in a similar way to the above: for fixed a € Z 
and / G let • • • , c~i, fi, . . . , cr„) be the a-signature as defined in 

( |2.29| ). Form the dual reduced a-signature by successively replacing sequences 
of the form — + (possibly separated by O's) with 00 until no — appears to the 
left of a +. Then: 

E*( f) / ^ there are no — 's in the dual reduced a-signature, 

' I / ~ leftmost — is in position j G /(m|n), 

and 

p*(f \ — i ^ there are no +'s in the dual reduced a-signature, 

a\J / I y _|_ jf ^j-^g rightmost + is in position j G I{m\n). 

Also 

£*(/) = the total number of — 's in the dual reduced a-signature, 
(/?*(/) = the total number of +'s in the dual reduced a-signature. 

In this way, we obtain the dual crystal structure {Z"^^"',E*,F*,e*,(f*,wt) on 
the underlying set Z"^l". 

Theorem 2.34. Let f G Z"*'" and a G Z. 

(i) EaLf = [e*(/)]L^.(^) + Ylgez^\"'^gjLg ^^^ere the coefficient w'^j be- 
longs to q'^~'^'^^-f^'Ii[q] and is zero unless <pl{g) < V^lif) for all & G Z. 

(ii) FaLf = ['/'a(/)]-^F*(/)+I]3eZ'"l"^3,/-^9 ^here the coefficient Xgj belongs 
to q^^^o-^f^Wjlq] and is zero unless £l{g) < £&(/) for all b £ Z. 



Proof. Dualize Theorem 2.31 using Theorem 12.231 and Lemma 2.21. □ 



3. Exterior algebra 

Now we descend from the tensor space j^"*!"- to '"f". We continue with the 
same notation as in section 2. 

§3-a. The space (f"*!"'. Let wq denote the longest element of S^^n- Let 

Ho:= E (-9)'^"^''^""^^. e ^m|n. (3.1) 

X G Sjj2 1 ^ 

The first lemma summarizes some elementary properties. 

Lemma 3.2. The following properties hold: 

(i) HiHo = —qHo = HoHi for any i G I{m — l\n — 1); 

(ii) ITo = Ho; 

(iii) Hi = -[m]\[n]\Ho; 

(iv) Ho = t{Ho); 

(v) the map uj : — > =^,|m rnaps Ho G J^m\n to Ho G J^n\m- 

Proof. Part (i) is an easy exercise. For (ii), use [ |Sol| , Proposition 2.9] and apply 
the map dia there. For (iii), one gets at once using (i) that 

Hl= ^ (-g)^(-')-^(-o)i/,.//o = Yl (-g)''^"^''^""^^o. 
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Now use the weh-known formula for the Poincare polynomial of S^^n to rewrite 
the sum. Finally, (iv) and (v) are obvious. □ 

Let (f"'!" := =3^™l"i?o, a '^-submodule of =^'"1". Note (f^l" is the g-analogue 
of the exterior power Form the completion (f*"!"- = ^^^'"'Hq as in 

2^ By Lemmas |2^(i) and|i|(v), the restriction of the map u : ^"l*" 



is an isomorphism oj : — >• 

We will caU / G Z™l" dominant if /(-m) < • • • < /(-I), /(I) > • • • > /(n). 
We warn the reader that the inequality signs here are strict, unlike in the earlier 
definition of antidominant! Let Z^'" denote the set of all dominant / G Z™!". 
For / G Z+l", let 

Kf := Mf.^^Ho G (3.3) 
The following lemma implies that the {Kf} m\n form a basis for 

Lemma 3.4. Suppose f G Z*"'" and let x G S^i^ be the unique element of 
minimal length such that f ■ x is antidominant. Then, 

[—qY^^^Kf.xwo if f • xwq is dominant. 



MfHo 



otherwise. 



Proof We have that Mj = Mf.^H^-i. So applying Lemma |3J(i), MfHo = 
Mf.^H^-iHo = {-qY^''^Mf.^Ho. Finally, note that if / • xwq is not dominant, 
then M/.^i?o = 0. □ 



§3-b. Canonical bases. Since Hq = Hq by Lemma |3.2| (ii), the bar involution 
on ^'"l" leaves ^"^1" invariant. Moreover, for dominant /, Kf = Mf.^gHo. 
So using Lemma 3.4 and the explicit description of Mf..^^ given by (Bl) and 
(B3) in the proof of Theorem p. 14 , we see that Kf = Kf + (*) where (*) is a 
(possibly infinite) Z[g, 5~^]-linear combination of i^^'s for g G Z'J^'" with g ^ f. 
Moreover, for typical dominant /, we have that Kf = Kf. As in Theorem p. 14 , 
these properties uniquely characterize the bar involution on (^"^1": 

Theorem 3.5. There exists a unique continuous, antilinear map — : £"^\'^ — > 
such that 

(i) Kf = Kf for all typical f G Z^'"; 

(ii) 'X^ = Xu for all X e and u G 
Moreover, 

(iii) bar is an involution; 

(iv) Kf = Kf + (*) where (*) is a (possibly infinite) 7,[q, q^^]-linear combi- 
nation of Kg 's for dominant g ~< f ; 

(v) ZAu) = Lj{u) for all u G ^""1". 

Proof. We have already proved existence above. For uniqueness, note on ap- 
plying Hq to the conclusion of Theorem 2.12 that we can write each Kf as, a. 

possibly infinite linear combination of XgKg's for Xg G ^ and typical g G Z™'"". 



KAZHDAN-LUSZTIG POLYNOMIALS 



23 



Hence, as in Corollary 2.13| , the only continuous -endomorphism of that 



fixes Kj for all typical / G is the identity map. Now using this one gets 



uniqueness by exactly the same argument as in the proof of Theorem 2.14. □ 



Now applying the general principles used in the proof of Theorem 2.17, we 
deduce: 

Theorem 3.6. There exist unique topological bases {UA „m\n, {LA m|n 

for ^'"l" such that 

(i) Uf = Uf and Lf = Lj; 

(ii) Uf G i^/ +g^^^^|„gZ[g]i^3 and Lf G Kf + ^^^^^ir.q-'Z[q-^]Kg. 
Moreover, 

(iii) Uf = Kf + (*) and Lf = Kf + (**) where (*) and (**) are (possibly 
infinite) linear combinations of Kg 's for dominant g -< f; 

(iv) uj{Uf) = U^^f) and uj{Lf) = L^^fy 

We use the following notation for the coefficients: 

Lf= Yl hMKg, Uf= Ugj{q)Kg, (3.7) 



for polynomials lg.f{q) G Z[q ^],Ugj{q) G '^[q]- We know that lgj{q) = 
'^gjil) = unless g ^ f, and lfj{q) = Ufj{q) = 1. 

Note that Kf = Mj + (*) where (*) is a g^-'^Z[g^-'^]-linear combination of Af^'s. 
So the element L f defined in Theorem |3.6| is bar invariant and equals Mf plus 



a q ^'L\q ^]-linear combination of Mg^. So by the uniqueness in Theorem 2.17 



the elements Lf and the polynomials lgj{q) defined here are the same as the 



ones defined in |§2-h| , for dominant g, f. Thus our notation is consistent with 
the earlier notation. The relationship between the elements Uf here and the 
Tj's from before is given by: 

Lemma 3.8. For f G Z™'", Uf = Tf.^^^Ho. 

Proof. Note that Tf.^^H^ is a bar invariant element of (^"^l". Recall that 7/.^^ 



equals Mf.^^^ plus a gZ[g]-linear combination of M^'s. So applying Lemma 3.4, 
Tf.,^gHQ equals Kf plus a qZ[g]-linear combination of Kg^s. Hence Tf.^^Ho = Uf 
by the uniqueness in Theorem |3.6| . □ 



§3-c. Duality. Recall the antilinear involution a : ^'"l" a^m\n (jgfjj^ed in 
( |2.8D . In view of Lemmas |2.9|(ii i) and |3.2| (ii), this leaves the subspace (^"^l" 
invariant. Indeed, by Lemma |3.4| , we have that 

a{Kf) = {-qY(^o)K_^^^^ (3.9) 
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for each / G 



ym\n 



Let (., be the bihnear form on (f™!"- defined so that the 

m|n are orthonormal. Note by Lemmas 12. 9|(ii) and|3.2|(iii) that 

— — 



elements {Kf} 

' — -t- 

{Kf,Kg)^ = {Mf.^^Ho,Mg.^,Ho)^ = -[m]\[n]\{Mf.^,^Ho, Mg.^,)^ 
= -{-q)-'^^'\m]\[n]\6f,g. 

Hence, 



{u,v) 



sr 



(3.10) 

ag 

(3.11) 



[m] ! [n] ! 

for all n, f E Finally, define a bilinear form (., on d'™'"' by setting 

for all u,v (z (^'"l". Comparing with the definition of the form (., .)^ from ( p. 201 ) 
and using ( p.lO| ), one sees immediately that 

{u,v)g = - I ^. {u,v)^ (3.12) 
m ! n ! 



for all u,v ^ (^"^1". Hence in particular we get from Lemma 2.22 that the form 
{■, ■)g is symmetric. 

Theorem 3.13. For f,g e Z™'", {Lf,U^g.^^)^ = df^g 

Proof. Since Lj € (^'"l", we have by Lemma 3.2(iii) that LjHq = —[m]\[n]\Lf. 
So applying Theorem 2.23 and Lemmas 3.8 and p.21| , we have that 



{Lf, U-g.WQ)g 



\m] ! In] ! 



sr 



[m] ! [n] ! 



{LfHo,T^ 



gisr 



^f,9- 



□ 



By the theorem and the argument used to prove Corollary |]2|, we get: 
Corollary 3.14. For f G 



ym\n 



Kf 



'^~f-wo,-g-woiQ )Lg — l-f.u)Q,-g-wo{Q )^g- 



9&T 



§3-d. Crystal structures. Next we describe the crystal structure on (f"!*^, 
following the same language as in §2-k. Recalling (p.3|), let 

EaU) := {KU ■ w^)) ■ Fa{f):=iK{f-wo))-wo, (3.15) 

ea{f) := e'M ■ wq), Mf) ■= M ' ^o) (3.16) 

for / € Z+l". Then, (Z+l",^,,^ , Ea, (/'a, wt) is the crystal associated to the 
'^-module (^"^1". Actually, the crystal structure is so simple in this case, that 
we can actually list all the possibilities explicitly. There are ten possible con- 
figurations for edges of color a in the crystal graph, listed below. Here, . . . 
denotes entries different from a, a + 1. 
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(1) 


(•• 


. , a, a + 1, . . . . 


. . ,o+ l,o, . . . ); 


(2) 


(•• 


. , a, a + 1, . . . . 


. . , o, . . . ) (. . . ,a, a + 1, . 


(3) 


(. . 

V 


.,(2+1.... 1... 


o + 1. a. ... ) ^'') ( . . . , a, . . . 


(4) 


(•• 


. ,a + 1, . . . 1 . . . 


\ I 1 

a, . . . j — > (. . . , a, . . . . . . , a 
















— ^ (. . . ,a, . 


(5) 


(•■ 


. ,a + 1, . . . . . . 


a + 1,...); 


(6) 


(•■ 


. , a, a + 1, . . . . 


••); 


(7) 


(•■ 


. . . . , a + 1, a, . 


■■); 


(8) 


(•• 


.[..., a,...) — 


^ (...|...,a + l,...); 


(9) 


(•• 


. ,a + 1, . . . 1 . . . 


) ^ (. . . ,a, . . . 1 . . . ); 


(10) 


(•• 







,a + l,a,...); 



,a + l,... 



We also have the dual crystal (Z^ 



K ,F*,el,ipl,wt), where , F* , e* and 

Combining ( ^.32 ) 



are the restrictions of the functions from §2-k to 
and (|3l^) , we have that 

K{-f-wo) = -F.i.M)-wo, F:{-f-wo) = -E.i.a{f)-wo. (3.17) 

Again, there are ten possible configurations for the edges in the corresponding 
dual crystal graph, all of which are exactly the same as (I)-(IO) above (replacing 
Fa with F*) with the exception of (4) and (5) which change to 

(4*) (...,a + l,...|...,a,...) ^ (...,a + l,...|...,a + l,...) 

(...,a,...|...,a + l,...); 

(5*) (. . . ,a, . . . I . . . ,a, . . . ). 

Remark 3.18. In ( |3.31| ) and Lemma 3.32| (v) below we will define mutually 
inverse bijections L,R : Z^'" — > Z™'". By considering all the above cases (1)- 
(10) one by one, it is not hard to check that L satisfies, indeed is characterized 
uniquely by, the following properties 



is typical then L(/) = /; 



(2) for every a G Z and / G 



ym\n 



E*L{f) = L{Eaf) and F*L{f) = L{Fafy, 



(3) for every / G Z™'", wt(L(/)) = wt(/). 

Hence, L : (Z^'", F^, Ea, Va, wt) (Z™'", F*, F*, e*, y?* , wt) is an isomor- 
phism of crystals with inverse R. 

The crucial observation to be made from the above description of the crystal 
graph is that all a-strings are of length at most 2. The following lemma is a 
consequence of this particularly simple structure. 

Lemma 3.19. Let f G Z^J^'" and a G Z. 

(i) Ifsaif) > 0, then EaUj = [Mf) + ^Pe^)- 
(fi) IfMf) > 0, then FaUf = K(/) + Ipp^^^y 
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Proof. We prove (i), (ii) being similar. Dualizing Theorem 2.34(i) using The^ 



orem 3.13| and Lemma |2.21| (or by considering the effect of the Kashiwara op- 



erators directly and arguing as in the proof of Theorem 2.31| ) gives us that 
EaUf = [Mf) + + Eg^z^l-ygjUg where y^^ belongs to 

and is zero unless £(,(<?) > £(>(/) for all b £ Z. Suppose that Vg f foi' some g. 
By assumption, ea[g) > £aif) > l, so (/?a((7) < 1 since all a-strings are of length 
< 2. SoO Ug J £ qZlq]. But Ug j is bar invariant, so this is a contradiction. □ 

§3-e. Two algorithms. In this subsection, we describe algorithms to compute 
the canonical basis {Uf} and the coefficients {lg,f{q)} of the dual canonical 
basis of explicitly. The first algorithm computes Uf, and is similar to the 



algorithm for computing the Ty's explained in ^2-] — but it is much simpler 



since no corrections are needed thanks to Lemma 3.1£ 



Procedure 3.20. Suppose we are given / £ Z™'" with #/ > 0. Compute 

h £ Z™'" and operators Xa,Ya £ {Ea, Fa}aez by following the instructions 
below starting at step (0). 

(0) Choose the largest i £ {— m, 1} such that f{i) = f{j) for some 
j £ {1, . . . , n}. Go to step (1). 

(1) If i < — 1 and f{i -|- 1) = f{i) + 1, replace i by (i -|- 1) and repeat step 
(1). Otherwise, go to step (2). 

(2) If f{i) -|- 1 = f{j) for some (necessarily unique) j £ {1, . . . ,n} go to step 
(1)'. Otherwise, set Xa = Ff{i), Ya = -^/(i) and h = f — di. Stop. 

(1) ' If j > 1 and f{j — 1) = f{j) + 1, replace j by {j — 1) and repeat step 

(1)'. Otherwise, go to step (2)'. 

(2) ' If f(j) + 1 = /(i) for some (necessarily unique) i £ {—m, . . . , —1} go to 

step (1). Otherwise, set Xa = Eji^j-j, Ya = Fj(^j) and h = f + dj. Stop. 

The following lemma follows immediately from the nature of the above pro- 



cedure and Lemma 3.19 



Lemma 3.21. Take f £ with > 0. Define h and operators Xa,Ya £ 



{Ea, Fa}aei. according to Procedure 3.2(\ . Then, one of the following holds: 



(i) ^h = In this case, the a-string through f is h /, of length 1. 
Moreover, XaUh = Uf, YaUf = Uh and XaKh = Kf. 

(ii) ^h = — 1. In this case, the a-string through f is h / g, 
of length 2. Moreover XaUh = Uf, YaUf = [2]Uh and XaKh = Kf + 

Case (ii) (when the atypicality gets strictly smaller) must occur after at most 
(m + n — 1) repetitions of the procedure. Hence after finitely many recursions, 
the procedure reduces f to a typical weight. 

Lemma p.21| implies the following algorithm for computing Uf. If f £ iT^"^ 
is typical then U f = Kf, since such /'s are minimal in the ordering < in Z'J*'". 



Otherwise, apply Procedure |3.20| to get h £ and Xa £ {Ea, Fa}a&- Since 
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the procedure always reduces / to a typical weight in finitely many steps, we 
may assume Uh is known recursively. Then Uf = XaUh- 

Example 3.22. Applying the algorithm repeatedly, we get that 

f^(0,l,3,4|2,l,0) = -^4-^3-£^2-?^l-^5-^4-E^3-^2-El-Fo-f'^(l,3,5,6|4,2,0) 

= -^{0,1,3,4|2,1,0) + ^-^(1,3,4,616,2,1) + 9-^^(0,3,4,515,2,0) + 'i'^-f'^(3,4,5,6|6,5,2) • 

In the next subsection, we will apply the above algorithm to derive a closed 
formula for Uf. We turn now to describing the second algorithm, which com- 
putes the polynomials lgj{q)- It will not be needed until §4-f| below. First we 
state a variation on Procedure ^.20 . 



Procedure 3.23. Suppose we are given g E with > 0. Compute 

h G Z™'" and operators Xa,Ya € {Ea, Fa}ael by following the instructions 
below starting at step (0). 

(0) Choose the smallest i E {—m, . . . , —1} such that g{i) = g{j) for some 
j E {1, . . . , n}. Go to step (1). 

(1) If i > —ni and g{i — 1) = g{i) — 1, replace i by (i — 1) and repeat step 
(1). Otherwise, go to step (2). 

(2) If g{i) — 1 = g{j) for some (necessarily unique) j E {1, . . . , n} go to step 
(1)'. Otherwise, set h = g + di, Xa = Ef^(^i-^ and Ya = F^iy Stop. 

(1) ' If j < n and g{j + 1) = g{j) — 1, replace j by (j + 1) and repeat step 

(1)'. Otherwise, go to step (2)'. 

(2) ' If g{j) — 1 = g{i) for some (necessarily unique) i E {—m, . . . , —1} go to 

step (1). Otherwise, set h = g — dj, Xa = Fh{j) = ^h{j)- Stop. 

Lemma 3.24. Suppose g,f ^ ZT'" with ^g > 0. Define h and operators 



Xa,Ya E {Ea, Fa}aeZ according to Procedure 3.25. Then, 
interpreting ^hY*{f)(~^~^) '^^ ^ ''■f^aif) — ^ 



^h,Y*{f)i-1 ^) if#h = #g, 

V„*(/)("^"^) +«^x,(/i),/(-9"^) 'f#h = #g-l, 



Proof. Let f,g ^ with #/ > 0. Apply Procedure 3.20 to construct h and 



operators Xa,Ya E {Ea,Fa}a&- Apply the operator Xa to both sides of the 
equation 

Kh = ^ l-h-wo-kwo{q~^)Uk 



from Corollary 3.14. In the case that #/i = we know by Lemma 3.21 
that h, hence also all k E Z™'" with the same weight as h, is at one end of 
an a-string of length 1. So by Lemma 3.19 , XaUk = Uj^ ^^^-^ for all k with 

l_h-wo-k-wo{Q~^) 0. Hence, 

Kf = XaKh= ^ l-h-wo-k-wo{Q^^)Ux^(^i,y 



m n 
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On the other hand, if = — 1, then h, hence also ah k of the same weight 
as h, lies at one end of an a-string of length 2, so XaUk 

So in this case 



from Lemma |3.21| that XaKh 

l—h-wo,—k-wo 



K 



f 



I n 



^Xa(k)- know 



-X*{h)-wo,-g-wo 



Now compute the coefficient of Ug in the above expressions for Kf using Corol- 
lary 3.14 again, to get 

' U.^o,-n{s)-o(^"') if #/i = #/, 

'^^-Xiih^-vin.-n-mS^ ) 



L 



f-WQ-g-WQ 



1, 



-X*{h)-wo,-g-WQ^ 

interpreting l_y^.^^ -Ya{g)-wo^l) ^ ^ ^a{g) = 0- The lemma follows from this, 
replacing / by —g ■ wq and g hy —f-wo and using (3.17), since Procedure 3.23| 



is just Procedure 3.2C twisted by the involution / i— > — / • wq. 



□ 



Now to compute lgj{—q ), we have that lgj{—q 



6gj if g is typical. 



and it is if (7 ;^ /. Otherwise, if ^g > and g ^ f, apply Procedure |3.23| and 



Lemma |3.24 to write lgj{—q ^) in terms of lhY*{f)(~^ ^) ^^'^ (™ ^^^^ 



#(7 — 1) lxa{h) f^~1 )' ^^'^ repeat. This process terminates in finitely many 
steps, because h is closer to being typical than g in the sense of Procedure |3.23 , 
and Xa{h) is closer than g to failing the condition g ^ f. Note this algorithm 
shows in particular that lgj{—Q~^) G as also follows from the explicit 

description given in Corollary 3.39| (ii) below. 

§3-f. Combinatorial description of canonical bases. We now introduce 
some combinatorics to enable us to write down closed formulae for the canonical 
basis and dual canonical basis elements. The material in this subsection was 
inspired originally by p^ . Suppose / G Z"^!*^ is conjugate under the action of 

We will denote this "dominant conjugate" of / by 



Sm\n to an element of 



yin\n 



/+. For —m <i<0<j<n with f{i) = f{j), let 

U,j{f) ■■= f - a{di - d 



(3.25) 



where a is the smallest positive integer such that / — a{di — dj) and all Lk^i{f) — 
a{di — dj) {oTi<k<0<l<j with f(k) = f{l) are conjugate to elements of 



ym\n 



Similarly, let 



\j{f) := f + b{di-dj 



where b is the smallest positive integer such that / + b{di — dj 



(3.26) 

and all Rk,i{f) + 



b{di — dj) for —m < k < i,j < I < n with f{k) = f{l) are conjugate to elements 



of 



yTnln 

Now take / € 



„m\n 



Let r = #/ and 



ji < n be the unique integers with f{is 



-m < ii < ■ ■ ■ < ir < < jr < ■ ■ ■ < 
= f{js) for each s = 1, . . . , r. For a 
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tuple 6* = (6*1, ... , Or) G W, \e\ denotes 6*1 H h 6*^. Let 

L^(/)=(Lt>°L^->-.°•••°L^,,(/))^ (3.27) 

L^(/) = fe°L£,,o...oLt,„(/))\ (3.28) 



^'eif) = (<:.v ° ° • • • ° i^L. (/)) • (3-30) 

Note that Lg{f),Lg{f) ■< f ^ Re(/),Rg(/). The operators Lg and will only 
ever be used for 6 belonging to the set {0, 1}''. In the special case that 6i = 
■ ■ ■ = Or = 1, we let 

L(/):=L,(/), R(/):=Re(/). (3.31) 

The following combinatorial lemma lists some elementary properties of the low- 
ering and raising operators, which follow immediately from the definition. 

Lemma 3.32. Let f G Z^'" and r = 

(i) Suppose 9 G W and let (f = {9r, ■■■ ,0i). Then, Rg{— f -wq) = —Ly,{f)-'Wo 
and Rg(-/ • wq) = -L'^{f) ■ wq. 

(ii) The sets {Le(/)}6»e{o,i}'' ^'^'^ {^d{f)}e£{o,iy contain 2^ distinct ele- 
ments. 

(iii) Suppose 9 G {0, 1}'' and let cp = {1 - Or, . . . ,1 - 9i). Then, Lg{R{f)) = 
R(^(/) diT'd Re(L(/)) = L^(/). In particular, taking 9i = ■ ■ ■ = 9r = 1, 
the maps L, R : Z™'" — > Z™'" are mutually inverse bijections. 

Example 3.33. Take / = (0, 1, 3, 4|2, 1, 0) as in Example ^2% , so #/ = 2. 
Then we have that L(o,o)(/) = (0, 1, 3, 4|2, 1, 0), L(i,o)(/) = (1, 3, 4, 6|6, 2, 1), 
L(o,i)(/) = (0,3,4,5|5,2,0) and L(i_i)(/) = (3, 4, 5, 6|6, 5, 2). Observe these are 
exactly the i^^'s appearing in the expression for Uf computed in Example |3.22 . 

The main theorem of the subsection is the following. 
Theorem 3.34. For / G Z™'" and r = #f, 

6'e{o,i}'' 

(ii) Kj=Y,{-qf\U,,^fy 

Proof, (i) If / is typical, then Uf = Kj and there is nothing to prove. So 
suppose that > and define h and Xa.,Ya G {-Ea, -Pajagz according to 
Procedure 3.20 . We may assume by induction that the result has already been 
established for h. Recalling Lemma 3.21 , we need to consider two cases. In 
the first case #/i = #/, we know that Uh = Y,ee{o,iY l^^^^uW- Applying Xa 
to both sides, noting that XaUh = Uf and that XaKi^g(^h) = ^i^eif) each 
0, gives the desired conclusion. In the second case 7^/1 = — 1. This time. 
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we know that Uh = X]eG{o ly-^ Q^^^^Lg{h)- For each 9, Lg{h) here has the form 
(. . . , o + 1, . . . I . . . , a, . . . ), so 

^aKi^g(h) = -f^(...,a,...|...,a,...) +^^(...,a+l,...|...,a+l,...) = ^Leuoif) + I^Uui(f)^ 

where 6U x denotes {6i, . . . , 9r-i,x) G {0, 1}''. So again we see on applying Xa 
to both sides that Uj = XaUh = I]ee{o,i}'- Q^^^^Lgif)- 

(ii) To deduce this from (i), we wih work in the free g~^]-module tM™!" 
on basis {[/Ijr^r^min „ , completed to a topological Z[q,q~^]-module Al™"!"" 

exactly as in |§2-d| so that expressions of the form [/]+(a possibly infinite linear 
combination of [g]'s with g < f) make sense. We define continuous linear maps 
U, K : ^ ^'"l" by letting [/([/]) = Uf+,K{[f]) = Kf+. These maps have 

the right inverses U'^,K-^ : ^ jW"^!" with U~\Uf) = [f],K-\Kf) = 

[/] for each / € Z™'". Finally, define continuous linear operators Xij : Al™'" — > 
A^™'!" for each —m <i<0<j<nhy 

I if/«//(j), 
for each / € Z^'" • 5^1^. Now consider the maps 

P:=Koi f[ (1 + qXij) I o : ^"^1" ^ 

y-r?i<i<0<j<n y 

where ]^ is taken in some ordering with i's decreasing and j's increasing from 
left to right and Yl is taken in the opposite ordering, and denotes (1 — 

qXij + g^Ajj — ...). By (i) and the definition of the operator Ljj, the map P 
sends Uf to Uf, so P = id. On the other hand the result we are trying to prove 
is equivalent to the statement that Q sends Kf to Kf. Therefore we will be 

done if we can show that P o Q = id, i.e. that for every / G Z^'"", 



/• 



Kol l[ (l + gA„))o(C/-io[/)o[ f[ —L-]([f]) = K 

\-m<i<0<j<n J \-m<i<0<j<n ^ J 

This is obvious if we can show that the inside map [U^"^ o U) : [g] i-^ [g^] on 
the left hand side can be omitted. For this, we check that 

Kol f[ {I + qX,A {[g+]) = K o I f[ {1 + q\A {[g]) 

\—m<i<0<j<n I \ -m<i<0<j<n / 

(3.35) 
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for every g E Z*"!" such that [g] is involved in ^Yl i+qx ^ ([/]) with non-zero 

coefficient. Suppose we have such a g. The crucial observation is that whenever 
there exist — m <i'<i<0<j<j'<n with g{j) = g{i) < g{i') = g{j')., one 
can find c with g{i) < c < g{i') that does not arise in the tuple g. Given this it 
is not hard to see that ( 3.35D holds. □ 

Corollary 3.36. For f £ Z™'", 

(i) Kf = J2g 9 '^^'-^g where the sum is over all g G Z™'" such that Rdgid) = 
/ for some (unique) 9g € {0, 1}*^; 

(ii) Lf = 0{—Q)^^^^Kg where the sum is over all g G Z^'"" and 9 € N*^ 
such that ^n{g) = /. 



Proof, (i) Recall from Corollar y p.l4| that the coefficient of Lg in Kj is equal to 
By Theorem |3.34| (i) and Lemma |3.32| (ii), u./.^g .^.^^(g-i) = 
q-\^\ if —f . = Lei—g ■ wq) for some (necessarily unique) 6 G {0, 1}*^, and is 
zero otherwise. Equivalently, invoking Lemma |3.32| (i), u_f.y^Q^_g.y^g{q~^) = q~\^\ 
if / = Reig) for some 6, and is zero otherwise. 

(ii) By Corollary 3.14| again, lgj{q~^) is equal to the coefficient of U-j.^g in 
K^g.wQ. By Theorem 0.34| (ii), this equals X]5i(— Q')'^' where the sum is over all 
6 G N#f with L'g{-g ■ wq) = -f ■ wq, equivalently, R'^^g) = f. □ 

Example 3.37. Suppose / = (— m, . . . , —2, — 1| — 1, —2, . . . , —n), so r = = 
min(m, n). We observe that any g ^ f can be represented as Lg(/) for a unique 
element 9 £W with 9i < ■ ■ ■ < 9r- Moreover, this 9 is also the unique element 
of N'' with the property that / = Rg{g)- We deduce from Corollary 3.36| (ii) that 

Lf= E (-'?)''"^L^(/)- (3-38) 

6l=(6»i<---<0r)GN'- 

Recalling the definitions from (3.7), we can restate Theorem 3.34K i) and 
Corollary 3.36| (ii) as follows: 

Corollary 3.39. For g,f e Z+'", 

(i) Ugjiq) = gl^l ifg = Lg{f) for some 9 G {0, Ugj{q) = otherwise; 

(ii) lgj{—q^^) = Ylel^^^ summing over all 9 G N*^ with R'gig) = f ■ 



Example 3.40. Using Corollary |3.39K ii) and arguing by induction on n, one 
gets that lgj{-q'^) = q^il+q^T'^, for / = (0, 2, . . . , 2n - 2|2n - 2,... ,2,0) 
and g = (2,4, . . . , 2n|2n, . . . , 4, 2). 

Corollary 3.41. For f,g G Z+'", = <l*^Ug^^f^{q-'^). 

Proof. Let r = By Corollary 3.39| (i) and Lemma 3.32| (i), we know that 

U-g.wo,-f-woiQ) = 9'^' if 5 = Reif) for some 9 G {0, l}*^' and is zero otherwise. 
Similarly, by Lemma p|iii), Ug^j,^j){q) is gl^l = q'-M [f g = Le{Rif)) = R^(/) 
for some 9 G {0, 1}'' and if = {1 — 9r, ■ ■ ■ ,1 — 9i) and is zero otherwise. □ 
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§3-g. Length function. We now consider some furtlier properties of the 
polynomials lgj{q)- 

Lemma 3.42. Let g, f ^ Z™'" with g < f and set r = #g = There exists 
a unique 9 = 9{g, f) € N*" such that 

(i) / = Kia); 

(ii) if f = R^(5') for some 9 ^ ip (zW then \ip\ < |^[ and \ip\ = \9\ (mod 2). 

Given in addition h E Z™'" with h < g < f , 9{h, f) = 9{h,g) + 9{g,f). 

Proof. We just explain how to construct 9, and leave the rest of the proof to 
the reader. Define —m < ii < ■ ■ ■ < ir < < jr < ■ - - < ji < n such that 
g{is) = g{js) for each s = 1, . . . , r, and — m < i'^ < ■ ■ ■ < i'^ < Q < j[. < ■ ■ ■ < 
j{ < n such that f{i's) = f{j's) for each s = 1, . . . , r. For < s < r, let 

s 

9s = g + ^{g{is) - f{Q){di^ - djj, 

t=l 

so go = g and (gr)^ = f ■ Now for each s = 1, . . . , r, let 0^ be the unique non- 
negative integer such that R^^'' •^(s's-i) = g^, recalling ( 3.26| ), and take 9 = 9{g, f) 



to be the tuple . . . , 0^)- D 



Using Lemma |3.42| , we can introduce a length function on Z™'". Suppose to 
start with that g ^ f. Let i{g, f) = \9{g, f)\, where 9{g, f) is the tuple defined 
in the lemma. Notice that if /i ^ g ^ /, then 

i{h,g)+eigj)=iih,f), (3.43) 

as follows from the stronger fact that 9{h,g) + 9{g,f) = 9{h,f) established 



by Lemma |3.42| . This allows us to extend the notion of length to arbitrary 
g, f G Z™'"" with wt{g) = wt(/): pick h G Z™'"" with h < g and h < f and set 
^(^i /) = ^{hj f) — ^{h, g). To check that this is well-defined, suppose h' E Z^'" 
also satisfies h' < g and h' < f . Choose another k G Z™'" with k < h and 
k^h'. Then using dOsj) , 

i{K f) - Kh, g) = m, h) + eih, /)) - (iik, h) + eih, g)) 

= £{k,f)-lik,g)=iih',f)-£ih',g), 

as required. So we have now defined i{g,f), the length of f relative to g, for 
arbitrary g, f £ ZT'" with wt{g) = wt(/). It is immediate from the definition 



that ( p3D holds for all h,g,f e Z"'" with wt(/i) = wt{g) = wt(/). 



Finally we can somewhat arbitrarily introduce an absolute notion of length. 
For each weight 7 of f^™-!", we fix a choice of "origin" o-y G Z*!^'" with wt{oy) = 7. 
Then for any / G Z™'", we define 

^(/):=^(oy,/) (3.44) 

where 7 = wt(/). The important thing is that if wt(g) = wt(/), then i(g, f) = 
l{f) — l{g), so we can recover the length of / relative to g from the absolute 
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lengths of / and g. In this notation, Lemma p.42 (ii) and Corohary 3.3S| (ii) 
combine to show: 

Corollary 3.45. For g, f £ Z^'" with g ^ f, the polynomial lgj{—Q~^) belongs 
to g^(/)-^(9)N[g-2]^ and the coefficient o/g^(/)-^(3) ^5 1. 

4. Representations of Ql{m\n) 

We now relate the combinatorics developed in sections 2 and 3 to two natu- 
ral categories Om\n ^^^d -^mln of representations of gl(m|n). For basic notions 



regarding Lie superalgebras, we follow |Kal|. We denote the parity of a vec- 



tor t; in a vector superspace by t; G Z2. For a Lie superalgebra fl = 0o ® 01 
and 0-supermodules M,N, the space Homg(M, A^) has a canonical Z2-grading, 
and the category of all g-supermodules is a superadditive category in the sense 
of Q ch.3,§2.7]. We will use the notation M ~ as opposed to the usual 
M = to indicate that there is an even isomorphism between M and A'^. Also 
n denotes the parity change functor. 

§4-a. Two categories. From now on, we let g denote the Lie superalge- 
bra gl{m\n). So 3 consists of (m + n) x (m + n) matrices over C, where we 
label rows and columns of such matrices by the ordered index set I{m\n) = 
{—m, . . . , —1, 1, . . . , n} as in the introduction. For i € I{m\n), let z = if i > 
and 1 if i < 0. Then, the parity of the ij-matrix unit Cjj € is i + j, and the 
superbracket satisfies 

[e^,J, ek,i] = 5^,kei,i - {-lf^^^^^^''^5,,iek,r (4.1) 

Note that the subalgebra of is isomorphic to Q[{m) © 0l(n). We will need 
some other important subalgebras: let f) denote the standard Cartan subalgebra 
of consisting of all diagonal matrices, let b be the standard Borel subalgebra 
of all upper triangular matrices, and let p = 05 + b. 

For A G [)* and a 0-supermodule M, we define the A-weight space Mx of M 
with respect to f) as usual: M\ = {m G M \ km = \(h)m for all h G f)}. Given a 
0-supermodule M such that M = ^xei)* ^^^^ consider the graded dual 

:= 0;)^g(,* Homc(M;^,C) with the usual Z2-grading and 0-action. Twisting 
the 0-action on M* with the automorphism X —X^^, where st : — > is the 
supertranspose eij 1— > {—iy^^~^^^ej^i, we obtain a new 0-supermodule denoted 
M'^. If all the weight spaces are finite dimensional, then there are natural 
isomorphisms (M*)* ~ M and [M'^Y ~ M. 

Let {(^i}ig7(m|n) be the basis for f)* dual to the basis {ei,i}jg7(m|n) for f}. Define 
a symmetric bilinear form (.|.) on f)* by declaring that {Si\5j) = (— The 
Weyl group W associated to the reductive Lie algebra 05 can be identified with 



the symmetric group S^in from |§2-a| . It acts linearly on t)* so that xSi = 5xi for 
X (z W,i € I(m\n). As before, we write wq for the longest element of W. We 
will also need the dot action of W on X{m\n) defined by x • A := x{\ + p) — p 
where 

iG/(m|n) 
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The root system of g is the set R = {5i — 6j \i,j € I{m\n),i 7^ j}. We write 
R = Rq L) Ri where Rq consists of all even roots 6i — 5j with i = j, and i?j 
consists of the remaining odd roots. Corresponding to the Borel subalgebra b, 
we have the standard choice of positive roots R'^ = R^ U = {6i — 6j \i,j G 
I{m\n),i < j}. The dominance ordering on f)* is defined by A < /i if (/x — A) is 
an N-linear combination of positive roots. 

From now on, we will restrict our attention to the integral weights, i.e. the 
weights belonging to the subset X{m\n) of i)* consisting of all Z-linear combi- 
nations of {5j}ig/(mln)- For A = ^i(zi(^rn\n) ^i^i ^ Xim\n), wc define its parity 

A:=A_™ + --- + A_2 + A_i GZ2. (4.3) 
Let X^{m\n) be the set of all dominant integral weights, namely, the A = 
J2iei{m\n) ^i^i ^ X{m\n) such that \-m > • • • > A_i and Ai > • • • > A^. Define 
a bijection 

X{m\n) ^ Z™l", A ^ /a (4.4) 
where f\ € Z™!" is the function defined by fx{i) = (A + p\5i) for i € I{m\n). 
Under this bijection, X~^{m\n) maps onto Z™'", see |§3-4 Also fx x = fx ■ 
for each x G W = Sm\n-, i-e- the dot action of W on X{m\n) corresponds to the 
action of Sm\n on Z™'" introduced in ^2-a . Now we lift all the remaining combi- 



natorial definitions involving Z™''"' directly to X{m\n). For instance, recalling 
(|2.3D , we define the degree of atypicality #A of A € X{m\n) by #A := #/a; this 
is the same notion as in [p^, ( 1.1)]. Similarly, let wt(A) := wt(/A), an element of 
the weight lattice P, see ( |2.2[) , and write A ^ /u if /a ^ see ^2-b , This order- 



ing on X{m\n) plays the role of the Bruhat ordering, see e.g. Theorem 4.31 (ii) 
below. It should not be confused with the dominance ordering <: we have that 
A ^ /i ^ A < but not conversely. 

We are ready to introduce two categories of representations of g. All the 



results summarized in the remainder of this subsection are taken from |B2, 
section 7] , where they are deduced from a general framework for representations 
of graded Lie superalgebras similar to that of Soergel [po2|| . 

The first category is denoted Omlnj ^-nd is the (integral weight) analogue of 
the [BGG] category O for a semisimple Lie algebra. By definition, is 



the category of all finitely generated g-supermodules M that are locally finite 
dimensional over b and satisfy 

M= Ma. (4.5) 

\^X{m\n) 

An object P G Omln is projective if every (not necessarily even) morphism from 
P to a quotient of an object M G Om|n lifts to a morphism from P to M. By 



[B2, Lemma 7.3], the category C^ln has enough projectives, i.e. every object 
is a quotient of a projective object. Moreover, Omln is finite, i.e. every object 
has a composition series. For each A € X{ra\n), we have the Verma module 

M(A) := U{q) 0uib) Ca, (4.6) 
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where Ca is the one dimensional b-module of weight A concentrated in degree 
A. The significance of the choice of parity here will be explained in |§4-e| be- 
low. As usual, M(A) has a unique irreducible quotient denoted L{X), and 
{L{X)}x£X{m\n) is a complete set of pairwise non-isomorphic irreducibles in 

We say that an object M E Omln has a Verma flag if it has a filtration 
= Mo < ■■■ < Mr = M such that each Mi/Mi_i is = M(Ai) for some 
Aj € X{m\n). If M has a Verma flag and fi £ X(r?T,|n), we let 

(M : M(/x)) = dimRomo^^„{M,M{^,Y). (4.7) 

By [ |B2| , (6.1)], this computes the number of subquotients of a Verma flag of M 
that are = M^fi). There is an obvious refinement of these multiplicities: for 

(M : M(^))p := dimHomo^|„(M, M(;u)^)p (4.8) 

counts the number of subquotients of a Verma flag of M that are ~ I¥'M{^). 

By |B2| , Theorem 6.3], there is for each A € X{m\n) a unique (up to even 
isomorphism) indecomposable module r(A) € Omln satisfying the following 
properties: 

(Tl) r(A) has a Verma flag starting with M(A) at the bottom; 
(T2) Ext^^^^(M(//),r(A)) = for all /x e X{m\n). 

Moreover, by |B2| , (7.4)], the multiplicity of M(/x) in a Verma flag of T(A) is 
equal to the composition multiplicity of L(— A — 2p) in M{—fj, — 2p), i.e. 

(r(A) : M(/z)) = [M{-f, - 2p) : L(-A - 2p)], (4.9) 

for A,^ G X(m\n). In particular, (r(A) : M(A)) = 1 and (r(A) : M{p)) = 
unless /i < A. Consequently, we call T(A) the infinite dimensional tilting module 
of highest weight A. Finally, note that for every A € X(m|n), 

/-A-2p = -/a, (4.10) 
so the involution A i— > —A — 2/? on X(m|n) appearing in the formula (f4.9D 
corresponds to the involution / i— > — / on Z'"!" in /j -shifted notation. 

The second category we shall consider is the category J^-^in of all finite dimen- 
sional fl-supermodules satisfying ([4.5|). Again, this is finite and has enough pro- 
jectives. As is well-known, the irreducible finite dimensional gg-supermodules 
with integral highest weights are parametrized by the set X+(m|n). For A € 
X~^[m\n), let us write L'{\) for the corresponding irreducible highest weight 
representation of gg concentrated in degree A. Then, for each A G X+(m|n), we 
have the Kac module 

K{\) := U{0) (E)u(p) L'{X), (4.11) 

where we are viewing L'{X) here as a p-supermodule with elements of pg = qq 
acting as given and elements of pi acting trivially. For A € X~^{m\n), the 
irreducible module L(X) defined earlier can also be realized as the unique ir- 
reducible quotient of K{X), and {L{X)}x£x+{m\n) is a complete set of pairwise 
non-isomorphic irreducibles in J-.m\n- 
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When working in J-m\ni we wih talk about Kac flags in place of Verma flags. 
If M has a Kac flag, the number of subquotients of a Kac flag of M that are 
= K[fi) is denoted (M : K{p)), and can be computed by 

(M : Kifi)) = dimHom^^|jM,K(^)0. (4.12) 

Like in ([4.g|), there is a refinement denoted (M : K{^))p for p G Z2, counting the 
number of subquotients of a Kac flag of M that are ~ IP'K{^). By [|B2| , (7.6)] 
or ||Z|, Proposition 2.5], the projective cover -P(A) of L{X) in the category Tm\n 
has a Kac flag with K{X) appearing at the top, satisfying the BGG reciprocity 

{P{X)■.K{^,)) = [K{^^)■.L{X)]. (4.13) 

There are also indecomposable tilting modules in category Trnlm denoted U{X) 



for A G X~^{m\n). Here, by |B2, Theorem 6.3], U{X) S ^m|n is the unique (up 
to even isomorphism) indecomposable object such that 

(Ul) U{X) has a Kac flag starting with K{X) at the bottom; 

(U2) Ext^^|^(i^(/i), C/(A)) = for all /i G X+{m\n). 

Let /3 = n{6-rn + • • • + (^-1) — m{6i + • • • + 6n) be the sum of the positive odd 
roots. Then, by p32| , (7.7)-(7.8)] and parity considerations, we have that 

K{Xy ^ K{f3 -woX), (4.14) 

U{Xy ^ P{l3 -wqX). (4.15) 

Note (|4l^ ), (|1|) and ( p^ together imply 



(C/(A) : K(;u)) = [K{P - wofi) : L{(3 - wqX)], (4.16) 

for X,fie X+{m\n). In particular, (C/(A) : K{X)) = 1 and (C/(A) : i^(/x)) = 
unless fi < X. Accordingly, we will call U (A) the finite dimensional tilting 
module of highest weight X. We remark finally that 

ff3-woX = -fx-m- {m + n + l)!, (4.17) 

where 1 € Z™'*^ is the constant function i 1. Thus, up to a constant shift 
which can usually be ignored, the involution A 1— s- /? — wqX on X^(m\n) ap- 
pearing in the formula ( [4.16 ) corresponds to the involution / 1-^ —f-wo on 



£1, 



§4-b. Translation functors. We need some basic facts about central charac- 
ters. Let Z be the (even) center of U{q). The fixed choices of f) C b determine 



a Harish-Chandra homomorphism Lp : Z ^ ^(f))) see [pix| , 7.4.3]. Each A G f)* 
yields a central character xa defined by X\[^z) = X{ip{z)). To parametrize the 
integral central characters, i.e. the x\ for A G X(m|n), we use the following 
consequence of results of Sergeev [pg2| ] , see |^, Corollary 1.9]: 

Lemma 4.18. Given A, G X{m\n), we have that x\ = Xfi ^''^d only if 
wt(A) = wt(/i) (where wt(A) = wt(/A), see ^^)). 



For each central character let O^j- denote the full subcategory of Cm|n 
consisting of the modules all of whose composition factors have central character 



KAZHDAN-LUSZTIG POLYNOMIALS 



37 



X- We have the block decomposition 



as X runs over all integral central characters. Lemma |4.1§| shows that we can 
parametrize the integral characters x instead by the weights ^ P arising non- 
trivially in the tensor space ^'"1" of §2-d. Let us introduce some notation to 



do this formally. Suppose that 7 € P. Let = {0} if 7 is not a weight of 
^'"l", else let = O^^ where XeX (m|n) is such that wt(A) = 7. Then, we 
can rewrite the above block decomposition as 

OHn = ©^7> (4-19) 

where is non-zero if and only if 7 is a weight of ^'"l". We let pr^ : — > 
be the natural projection functor. In an entirely similar way, we have the 
block decomposition of J-'m\m 

-^H- = ©-^7> (4-20) 
where this time ^m|n is non-zero if and only if 7 is a weight of (^'"l", see |j3-a . 



Let V be the natural g-supermodule. So, V is the vector superspace on basis 
{fi}jg/(m|„), where Vi := i, and the action of the matrix unit Cij € g is given by 
GijVk = 5j,kVi- For r > 0, let S^'V be the rth supersymmetric power of V , a finite 
dimensional irreducible representation of g. Let S'^V* = S'^{V*) ~ (5""^)*. For 

(r) (r) 

o G Z and r > 0, we define additive functors Fa ,Ea ■ Om\n ~^ (^m\n 
follows. It suffices by additivity to define them on objects belonging to for 
each 7 e P. So if M G O^, we let 

F^M := pr^_,(,_,^^^)(M ® S'V), (4.21) 

Ei^^M := pr,+,,(,_,^^^)(M ® S^V^). (4.22) 

(r) (r) 

On a morphism 9 : M ^ N, Fa and Ea are defined simply to be the 

(r) 

restrictions of the natural maps 6 id. Clearly, the restrictions of Fa and 
Ej{^ to J^m\n give functors Fa '\Ea '' : Tm\n ~^ ^m\n too. The first well-known 
lemma gives the elementary properties. 

(r) (r) 

Lemma 4.23. On either category O^^n ^'^ ^m\n; Ea and Ea are exact func- 
tors, they commute with the t- duality, and are both left and right adjoint to 
each other. 

The next lemma is also quite standard, though we have included a proof since 
we wish to keep track of parity information. 

Lemma 4.24. Let z^i,...,zv^ be the set of weights of S'^V ordered so that 
Vi > i/j ^ i < j . Let A G X{m\n). 

(i) M(A) ® S'^V has a multiplicity-free Verma flag with subquotients ~ 
M(A + i^i), . . . , M(A + vn) in order from bottom to top. 
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(ii) M(A) <S> S'^V* has a multiplicity-free Verma flag with subquotients ~ 
M(A — ui), . . . , M{X — vn) in order from top to bottom. 

Proof. We prove (i), (ii) being entirely similar. By the tensor identity, 

M(A) ® S'-V = (C/(5) (^u{b) Ca) ^ S'V ~ U{q) ®u(b) (Ca ^ S'V). 

So it suffices by exactness of the functor t^(0)(8'c/([,)? to show that M := Cx ® 
S'''V has a filtration = Mq < Mi < • • • < Mn = M as a b-module with 
Mi/Mi-i ~ Ca+i/^. Let xi, . . . , jjat be a basis for S'^V , where Xi is of weight Vi. 
Then 1 Xj € Ca (8) 5'''F is of weight \ + and degree \ + Xi = \ + Vi = X + Ui 
(recall ( f4.3D ). So taking Mj to be the subspace spanned by 1 (g) xi, . . . , 1 (8" Xj 
gives the required filtration. □ 

Corollary 4.25. Let A € X(m|n) and a ^7L. Let (cr_m, • • • , C-i, fi, . . . , cr^) 
6e i/ie a-signature of fx, see ( 2. 2!^ . 

(i) Fa^''M(X) has a multiplicity -free Verma flag with subquotients ~ M(A + 
^ii + ■ ■ ■ + <Jir) /o?" fl^^ distinct ii, . . . ,ir G /(m|n) sitc/i t/iai fij^ = . . . = 
o-i, = +■ 

(ii) Ea'^ M{\) has a multiplicity-free Verma flag with subquotients ~ M(A — 
5ji — ■ ■ ■ — Sjr) for all distinct ji, . . . G I{m\n) such that = • • • = 
(T-i = — . 

/n both (i) and (ii), the Verma flag can be chosen so that subquotients appear 
in order refining dominance, most dominant at the bottom. 

Proof. The Verma module M(A) has central character xx so belongs to Owt(A) 
by Lemma 4.18| . Applying the exact functor pT^^(^x)-r{ea-ea+i) ^° filtration 
in Lemma [4.24 (i), we deduce that Fa^^ M{X) has a Verma flag with subquotients 
being the M(A+fj) such that wt(A+fj) = wt(\)—r{ea—Sa+i)- This implies that 
t^i = + ■ ■ ■ + for distinct ii, . . . ,is G I{m\n) such that = • • • = = +, 
giving (i). Part (ii) is similar. □ 

There is an analogous statement in the finite dimensional setting. 

Corollary 4.26. Let \ {m\n) and a & 7j. Let (a-m, ■ ■ ■ ,o'-i,o'i, . . . ,an) 

be the a-signature of fx, see ^2.2^\) . 

(i) Fji^ K{X) has a multiplicity-free Kac flag with subquotients ~ K{\-\-6i^-\- 

■ ■ ' + ^ir) for all distinct ii, . . . ,ir G I{m\n) such that \-\-5i^ +• • - + 61^ G 
X^{m\n) and CTi^ = ■ ■ ■ = Cj,, = +. 

(ii) Ea'' K{X) has a multiplicity-free Kac flag with subquotients ~ K{\—5j^ — 

■ ■ - —^jr) for all distinct ji, . . . ,jr G L{m\n) such that X — 5j-^ — -- - — Sj^ G 
X^{m\n) and CTj^ = ■ . . = (jj^ = —. 

In both (i) and (ii), the Kac flag can be chosen so that subquotients appear in 
order refining dominance, most dominant at the bottom. 

Proof. We prove (i). By universal properties, K{X) is the largest finite di- 
mensional quotient of M(A). S o sincG Fa is exact, F^''^K{\) is a quotient of 
Fa^ M{X) and Corollary 4.25| implies that Fa'^ K{\) has a filtration with sub- 
quotients being finite dimensional quotients of M(A + 5i-^ + • • • + (5j,,) for all 
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distinct ii, . . . ,ir G I{m\n) such that cxjj = ■ ■ ■ = fij^ = +. But such a quotient 
is zero unless A + + • • • + (5^^ G X~^{m\n). Hence, pjf^ K{X) has a filtration 
with sub quotients being quotients of the Kac modules K{X + + • ■ ■ + di^) 
for all distinct ii, . . . ,ir G /(m|n) such that A + (5i^ + • • • + G X+(m|n) and 
(Tjj = • ■ ■ = (Tj^ = +. Finally the fact that each factor is actually isomorphic 
to the corresponding Kac module, rather than a proper quotient, follows by 
a character calculation using the Kac character formula for K{fi), the Fieri 
formulae [ Ma4 (5. 16), (5. 17)] and Lemma 4. IS . □ 

Corollary 4.27. Let a G Z and r > 1. 

(i) For each A G X{m\n), each indecomposable summand of Fa^T{X) or of 
E^pTiX) is ~ T{fi) for fj, G X{m\n). 

(ii) For each X G X+(m|n), each indecomposable summand of Fa^U{X) or 
ofE^a^U{X) is ~ U{n) for ^ G X+{m\n). 

Proof. We prove (i) for Ea\ the other cases being similar. Let T be an indecom- 
posable summand of E^^T{X). We need to show that it has a Verma flag with 
subquotients ~ M{v) for various v G X(m|n), and that ExtJ,^|^(M(^), T) = 

for all II G X{m\n). The first statement is immediate since E'ih{X) has 
such a Verma flag by Corollary 4.25 , and summands of modules with a Verma 
flag also have a Verma flag, see [|B2|, Corollary 4.3]. For the second state- 
ment. Lemma [4.23| and a standard argument, see e.g. L4.4], shows that 

Ext^^lJM(^),£;i''^T(A)) ~ ExtJ,^^^|jFi''W(/i),r(A)). To see that the right 

hand side is zero, note that Fa'^ M{^) has a Verma flag by Corollary 4.25. 
By induction on length using the long exact sequence and the defining property 
(T2) of r(A), Ext^^i^ (M, r(A)) = for every M G O^i^ with a Verma flag. □ 

Let C^i^ be the full subcategory of consisting of all modules pos- 

sessing a Verma flag. Let K{0^^^ denote the Grothendieck group of the 
superadditive category in the sense of [BK, §2-c]. Note K{0^^,^) is 

a free Z-module on basis {[M{X)Wxi^x{m\n)- Similarly, let be the full 

subcategory of Tm\n consisting of all modules possessing a Kac flag, and let 
-^(•^m|n) denote its Grothendieck group. So -f^(-^^|ri) ^ ^^^^ Z-module on ba- 
sis {[K{X)]}xfzx+{m\n)- III view of Corollary |4. 25 and |4.26 , the functors Fa'^ and 
E^a^ map objects in O^^^ resp. J^^|^ to objects in O^^^ resp. J^^\n- Moreover, 
they preserve short exact sequences in O^^^ resp. Hence they induce 

Z-linear operators on K{0^^^^ and on K{T^^^). 

Now we make the connection to the modules ^'"l'^ and (^'"l"' from sections 
2 and 3 of the article. Actually we need to specialize these modules at q = 1. 
So let Z[g, g~-'^]-lattice in spanned by {Mj} j^^^m\n, in 

the notation of §2-d . Let '^^j'^-i] be the g^^]-lattice in spanned by 
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{Kf} j,^^m\n, in the notation of §3-a . Viewing Z as a 7,[q, (7^^]-module so that q 
acts as 1, we define 

We write Mf{l) (resp. Kf{l)) for the basis element 1 (8" Mj of J^'"" (resp. 

l(^Kf oi (f^'"). Similarly, we define Tf{l) = l®Tf and ?7/(l) = 1 ® (in 
case of Tf{l), recall that as a consequence of Conjecture 2.28| we expect it is 



a finite sum of Kg{\ys so belongs to , but without this we mean here to 

work in the completion 5^'" constructed as in |§2-dD . 

Note the generators Ea^ and Fa '^ of ^ = Uq{Ql^) specialize at g = 1 to 
the usual divided powers El^/r\ and F^/rl in the Chevalley generators of the 

Lie algebra qI^, so we can view ^^^'^ resp. as modules over the Kostant 

Z-form for the universal enveloping algebra U{gl^). 

Theorem 4.28. Identify K{0^^,^) with =13^''" via the 'L-module isomorphism 
i:K{O^^J-.^^^\ [M{\)]^Mj,{l). 

(r) (r) 

Then, the representation theoretically defined operators Fa ,Ea act in the 

(r) (r) 

same way as the Chevalley generators Fa ,Ea of "^z- 



Proof. Corollary |4.25 shows that the operators induced by the functors Fa' , Ea 



act on [M(A)] G K{O^^J in exactly the same way on K{O^^J as F!f\Ei''^ G 
act on M/Jl) G =^2™'". □ 



gous theorem for category 



An entirely similar argument, using Corollary 4.26| instead, gives the analo- 

\r 



Theorem 4.29. Identify K{J^^^^) with via the Z,-module isomorphism 

3 : K{Tt\^) ^ [K{X)]^Kf,{l). 

(r) (r) 

Then, the representation theoretically defined operators Fa ,Ea CLct in the 
same way as the Chevalley generators Fa ,Ea of'^z- 

§4-c. Tilting modules in category O^^n- We proceed to prove some results 
and formulate some conjectures about the infinite dimensional tilting modules 
T(A). For A G X{m\n), write 

M'(A) := U{q-o) Ca 

for the purely even Verma module for qq concentrated in degree A, and L'{X) 
for its unique irreducible quotient. We will need the following result of Kac 



[Ka3, Proposition 2.9]. Actually in loc. cit., Kac is only concerned with finite 
dimensional representations, but the same argument works for the general case 
stated here. 
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Lemma 4.30. If X £ X{m\n) is typical, then L{X) ~ U{g) (>S>u{p) L'{X). 

Recall the definition of the polynomials tgj{q) and lg.f{q) from ( |2.1g| ). We use 
the bijection (0) to shift notation, letting t^^x{q) := tf^j^{q) and l^^xiq) : = 
If^j^ig)- The first part of the following theorem is a reformulation of the 
Kazhdan-Lusztig conjecture [p<!L| for 0l(m) ©0((n), proved in [BB, BrK]. 

Theorem 4.31. Let A G X{m\n). 

(i) If X is typical then (r(A) : M{fi)) = tf^^\{l) for each fi G X{m\n). 

(ii) For arbitrary X, each suhquotient of a Verma flag of T{X) is ~ M{fi) 
for ^ ^ A. 

Proof, (i) For the proof, we will assume instead that A G X{m\n) is typical with 
A + /9 G X^{m\n). Let Wx be the stabilizer in W = S^^^ of A under the dot 
action, and let D'^ be the set of all maximal length W/Wx-coset representatives. 
Let Wx be the longest element of Wx- By the Kazhdan-Lusztig conjecture for 
the Lie algebra gg proved in p3B| , prK[ ] combined with the translation principle 
[Jl|, see also [ BGS| , Theorem 3.11.4], we have that 

[M'{x ■ A) : L'{y ■ A)] = P^,y{l) 

for arbitrary x,y G D^. Here, Px^y{l) denotes the usual Kazhdan-Lusztig poly- 
nomial associated to x,y G evaluated at 1, see |KL|. 

We claim that Px^y{l) = t-x-x-2p,-y-x-2p{^) for all x,y G D^. To see this, let 



/ := — fx, which is antidominant in the sense of |§2-aJ. Define Sf,Df as in |j;2-j 

We will use the fact that the map — > Df,x i— wxx~^ is a bijection. Observe 

using ( [I.IOD that f^y.x-2p = f-wxV'^- So by Lemma [2?25| , t_^.A-2p,-s/.A-2p(l) = 

if) ( f) 

tf.,„,T-i f.„K7,-i(l) = -1 -i(l)- Noting m _, _i (1) is the same as 

the element with the same name in [BoTl, [ pol| . Remark 2.6] and [Sol, Propo- 

fn — — — 

sition 3.4] show that "m^^^-i ^^y-ii^) = = Px',j/(1)- This proves the 

claim. 

Now M{x ■ A) ~ U{q) ©[/(p) M'{x • A) by associativity of tensor product, 
while Lemma [4. 30] shows that L{y ■ A) ~ U{q) ®[/(p) L'{y - A). So as the functor 
?7(g)(8'[/(p)? is exact, we deduce from the previous two paragraphs that 

[M{x ■ A) : L{y • A)] = t.x.x-2p,-yX-2p{l)- 

Note moreover that this argument shows that every subquotient of M{x ■ A) 
that is = L{y ■ A) is actually ~ L{y ■ A). Finally applying ( 4.16|) gives that 

{T{-y • A - 2p) : M{-x ■ A - 2p)) = t^x.x-2p,-yX-2p{l)- 

Part (i) of the theorem follows easily from this and central character consid- 
erations. Moreover, by an obvious refinement of ( 4.16| ) keeping track of parity 
information too, we see that every subquotient of a Verma fiag of T[—y ■ X — 2p) 
that is = M{-x ■ X-2p) is actually ~ M{-x ■ X-2p). 

(ii) We proceed by induction on ^^^A. The case that A is typical follows from 
(i). So suppose that ^X > and the theorem has been proved for all p with 

#p < #A. Let i : K{O^^J 5"/"'" be the map defined in Theorem |]28. 
Apply the algorithm explained in §2-j to f = fx to construct h = fy for v G 
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X{m\n) with < #A and a sequence Xi, . . . ^X^ of monomials in Ea^ and 



Fk''' . Let M := Xn ... XiT{v). Note by Corollary |]2| that M has a Verma 



flag, and each subquotient of a Verma flag of M is ~ for some ^ G 

X(m|n). By the induction hypothesis, z([T(z^)]) equals M/i(l) plus a linear 
combination of Mg(l)'s with g ^ h. By Lemmas p.lOj and p.ll , we deduce 
that Xat . . . Xii([r(^')]) equals Mf{l) plus a linear combination of Mg(l)'s with 
5 -< /. So by Theorem [4.28| , 



[M] = [M(A)] + (a hnear combination of [M(;u)]'s with ^ A). 
By Corollary 4.27| (i), T(A) is a summand of M, and the result follows. 
Motivated by the theorem, we formulate the following conjecture. 



□ 



Conjecture 4.32. Let i : K{O^^J =^2™'" be the map defined in Theo- 



rem (.2^ . Then, i{\T{X)\) = Tf^{l) for each A E X{m\n). 



In view of (4.9) this conjecture is equivalent to either of the statements 

(r(A):M(^))=t^,A(l), (4.33) 
[Af(A) : L(^)] = t-A-2p,-^-2p(l) (4.34) 
for all A, /i G X[m\n). By Corollary 2.24| and ( [4.10| ), the unitriangular matrices 
(^m,a(1))p ,\G X(m\n ) (^-A-2p,-/i-2p(l))p,Aex+(m|n) inverse to each other, 
so inverting ( [4.34| ) also gives that 

chL(A)= Yl W(l)chM(^). (4.35) 

AeX(m|n) 

Although the summation is infinite here, it involves only finitely many non-zero 
contributions to the dimensions of each fixed weight space of L{X), thus it can 
be viewed as a conjectural character formula for irreducibles in Omln- 



Further evidence for Conjecture 4.32 is given by the main theorem in the 



next subsection. We finally mention one other result which is in keeping with 



the conjecture, compare in particular with Theorem 2.34. Recall the definition 



of the dual crystal operators E*,F*,e* and ip* from §2-k. Again, we lift these 
directly to X(m|n) via the bijection (|43 



Theorem 4.36 (Kujawa). Let A G X{m\n) and a G 

(i) FaL{X) ^ if and only if 0, in which case it is a t -self-dual 
indecomposable module with irreducible socle and cosocle ~ L[F*[\)). 
Moreover, FaL{X) is irreducible if and only if (p*^[\) = 1. 

(ii) EaL{\) ^ if and only if £*^[\) 7^ 0, in which case it is a T-self-dual 
indecomposable module with irreducible socle and cosocle ~ L{E*{\)). 
Moreover, EaL{\) is irreducible if and only if e*{X) = 1. 



Theorem 4.36 is a result of Jon Kujawa that will form part of his PhD thesis 



[Ku]. The proof, which will hopefully appear elsewhere, is similar to the proof 
given in |B1] of Kleshchev's modular branching rules from |Kv{| . It involves 



some explicit calculations with certain lowering operators in U{g). 
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§4-d. Tilting modules in category ^rn.\n- Now we study the finite di- 
mensional tilting modules U{\). Lift the crystal operators Ea, Fa,£a,^a from 
3-d| to X^{m\n) through the bijection (|4.4| ), as well as the mutually inverse 



bijections L and R from ( |3.31[ ). 

Theorem 4.37. Let j : KiJ'^^J 4"'" map defined in Theorem \(.2{^ . 

Then, j([U{X)]) = Uf^{l) for each A € X^{m\n). Moreover: 

(i) Each subquotient of a Kac flag of U{X) is ~ K{fj,) for L(A) ^ /i ^ A; 

(ii) C/(A) P(L(A)); 

(iii) u{x) ^ uixy. 

Proof If #A = then Lemma implies that U{X) = P{X) = K{X) = L(A) 
and the theorem follows in this case. Now suppose that #A > 0. Let f = f\ 
and define h = fi, ioi v ^ X^{m\n) and operators Xa € {Ea^Ea^a&i according 
to Procedure |]2^. We may assume by induction that the theorem has been 
proved for u. 

Consider XaU{u). Theorem [4. 29] , Lemma |3.21 and the induction hypothesis 



shows that j{[XaU{v)\) = Xg Uf^ (1 ) = Uf^{l). So we get from the explicit de- 



scription of C//J1) in Theorem |3:34|(i) that [XaU{u)] = [K{X)\ + {*) + [K{h{X))\ 



where (*) is a sum of [/C(/i)]'s for L(A) -< n ^ X. Using Corollary 4.26| , we 



deduce from this and the induction hypothesis that XaU{v) has a Kac fiag 
with subquotients ~ K{X), K{h[X)) and all other subquotients ~ K{jx) for 
L(A) -< fj, ~< X. So XaU{i') must have a summand that is ~ U{X), recalling 
Lemma [4.27| (ii). Also U{u) ~ U{vY is projective by the induction hypothesis, 



hence XaU{u) ~ {XaU{i')Y is projective by Lemma 4.25 . So XaU{u) must 
have a summand that is ~ P(L(A)). To complete the proof, it just remains to 
show that XaU (z^) is indecomposable. For this, we give two different arguments, 
the first based on Theorem |4.3(]| and the second using instead a fundamental 
fact proved by Serganova in |S3|. 

Method one. Suppose the space 

Rom:p.iXaU{u),L{i,)) ^ Hom^„ , y,L(^)) 



is non-zero for some fi G X+(m|n). By the choice of a in Procedure 3.20 , A 



is not at the end of an a-string of length 2 in the crystal graph. Since we 



must have that wt{n) = wt(A) by Lemma 4.18, it follows that ^ is also not 
at the end of an a-string of length 2. Theorem 4.36 now implies immediately 
that YaL{fj,) ~ L{Y*{fi)). By the induction hypothesis, U^v) is the projective 
cover of L(L(i^)), so we deduce from the non-vanishing of the right hand hom 
space above that Y*{iJ,) = L(i^). Hence, /x = X*(L(i/)) = L{Xa{i^)) = L(A), 
using Remark |3.18| (2) for the penultimate equality. We have now shown that 
cosoCg(Xa{7(i/)) ~ L(L(A)), so it is indecomposable. 

Method two. Suppose XaU{i') is decomposable. Then, by what we have shown 
already, we can write XaU (v) = Ti ©T2 where Ti ~ [/ (A) and T2 7^ is a direct 
sum of indecomposable tilting modules. Note that YaTi ^ for each i, indeed 
we have by adjointness that 

Hom^,„jJt/(i.),y,T,) ^ Hom^^,„(X,C/(i.),r,) / 0. 
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Recalling Lemma 3.21 , we now consider two cases. First, suppose that v is at 
the end of an a-string of length 1. Then, we have that YaUf^{\) = Uf^{l), i.e. 
[YaXaUlv)] = [U{iy)]. Since YaXaU{v) is a direct sum of indecomposable tilting 
modules, we deduce that U (v) = YaXaU (u) = YaTiQYaT2, a contradiction since 
U{u) is indecomposable. Otherwise, we have that is at the end of an a-string 
of length 2, and [YaXaUlv)] = 2[U{i')]. Hence this time we must have that 
YaTi ^ YaT2 = U{u). In particular, we get that [YaU{X) : L(i/)] = 1. We now 
show that [YaU{X) : L{i>)] > 2, to get the desired contradiction. 

Let fj, = X*(i'), so ^ = A — a for some a € Rj with (A + p\a) = 0. By 
[||, Theorem 5.5] and (|4l^ ), we have that [K{X) : L{n)] > 1 and that (C/(A) : 
K{fi)) = [K{P - wofi) : L{P - wqX)] > 1. Hence, [U{X) : L{n)] > 2, since it 
has a Kac flag involving both K{X) and K{fi), each of which have L{fi) as a 
composition factor. Now XaK{h') has a two-step filtration with K{X) at the 
bottom and K{fi) at the top, hence 

Hom^„l„(K(z.),y,L(;u)) ^ Hom^^,jX,i^(i.),L(^)) / 0. 

This shows that \YaL{ij,) : L{i')] > 1. Finally applying the exact functor Ya to 
U{X) and combining our two facts [U{X) : L{fi)] > 2 and [YaL{fi) : L{iy)] > 1 
gives that [YaU{X) : L{h')] > 2 as required. □ 

Now recall the definition of the polynomials Ugj{q) and lgj{q) from ( [S.?] ). 
As usual we shift notation, writing u^^x{q) := Uf^j)^{q) and lfj,^x{q) '■= l-f^Jxil)- 
Combining the theorem with ( |4.16[ ), we get that 

(C/(A):ir(^))=n^,A(l), (4.38) 
[K{X) : Lifi)] = n^-^„A,/3_^oM(l)- (4-39) 
The Main Theorem stated in the introduction follows immediately from the 
second of these formulae and Corollary |3.36| (i), since in view of (|t3) and 



Corollary |3.14| that gives an explicit formula for u^-«;oA,/3-woai(1)- particu- 



lar, [K{X) : L{fj.)] < 1 for all A,^ S X~^{m\n), as was conjectured in | HKJ , 
Conjecture 7.2], and L{fi) appears as a composition factor in exactly 2*^^ dif- 
ferent Kac modules K{X), as was conjectured in |HKJ, Corollary 7.3]. 



By Corollary 3.14| and ( |4.17| ), the unitriangular matrix (/^^A( l))^,A gX+(m.|n) 



is the inverse of {uf3_^gX,f3-wofii'^))fi,xex+{m\n)- So on inverting ( [4.39|) , we also 
get that 

chL(A)= Yl l^.^{^)chKi^i). (4.40) 

/ieX+(m|n) 

This can be viewed as a character formula for the finite dimensional irreducible 
9l(m|n)-supermodules with integral highest weight. The explicit description of 
the coefficients ^/i,A(l) given by Corollary 3.39K ii) seems to be quite different 



from the explicit description given by Serganova |S3| , Theorem 2.3], and I have 
been unable to prove combinatorially that they are equivalent. 

To conclude the subsection, let us record one more consequence of Theo- 



rem 4.37 



Corollary 4.41. For X G X+{m\n), L{Xy ~ L{P - u;oR(A)). 
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Proof. By (|4l5|) and Theorem P{p-woR{X)) ~ t/(R(A))* ~ P(A)* and it 
is self-dual under the duality r. Hence L{P — 'wqR{X)) ~ soCgP(/? — tyoR(A)) ~ 
soCgP(A)* ~ (cosoCgP(A))* ~ L{Xy. □ 

Remark 4.42. A different description of the highest weight of -^^(A)* can be 
derived using Serganova's odd reflections, see |Sl|, Lemma 0.3] and pKu| , 

Theorem 4.5]. In view of ( 4.39 ) and (|4.14 ), Corollary [4.41 implies (indeed is 
equivalent to) the equality up-wofj.,i3-wox{^) = '"/i,R(A)(l)) see Corollary |3.41 for 
a stronger statement. 

§4-e. Highest weight categories. Let T^^^ (resp. -^^|^) be the full subcat- 
egory of J^m\n consisting of the modules all of whose composition factors are 
~ -^^(A) (resp. ~ nL(A)) for A G X+(m|n). Obviously, the parity change functor 
n defines an isomorphism between , and J-^ , . Since each End^- , (L(X)) 

^ m\n m\n -^m|n \ v // 

is concentrated in degree 0, each Hom^^|jM,Ar) for M, iV G J^^^ is also 
concentrated in degree 0, hence is an abelian category. 

Lemma 4.43. For X G X^{m\n), each of the objects U{X), P{X), K{X) and 
L(A) belong to Moreover, the dualities ★ and r and the functors Fa^ and 

Ea^ map objects in to objects in J^' 



m|n ■ 



Proof. By Theorem 0^(1), each subquotient of a Kac flag of U{X) is ~ K{lj) 
for some ^ € X~^{m\n). We deduce using ( 4.14 )- (|4.15| ) that each subquotient 
of a Kac flag of P{X) is ~ K{^) for some ^ G X~^{m\n). By the obvious 
refinement of ( [4. 131) keeping track of parities, it follows that each composition 
factor of K{^) is ~ -^^(A) for some A G X~^{m\n). Combining these statements 
shows that ah of U{X),P{X),K{X) and L(A) belong to For the remammg 

statement, we obviously have that L{XY — L{X), hence r leaves ^^i„ invariant. 



The same thing for ★ follows from Corollary 4.41 . Finally, Corollary 4.26| shows 



that the exact functors pjf^ and E^'^ send K{X) to an object in J'^^^, and L{X) 
is a quotient of K{X) so they must also send L{X) to an object in J^^ 



□ 



Corollary 4.44. For any M,N eJ^^ 
concentrated in degree 0. 



and i >0, the space Ext^ 



m\n' 

iM,N) is 



Proof. We have already noted this is the case if i = 0. To get the general case 
from this, note by the lemma that every composition factor of every term of 
the obvious minimal projective resolution of M belongs to D 

It follows easily from the corollary that every object M G J'rn\n decomposes 
uniquely as M = M° with MP G J^^|^ for each p e Z2. We deduce that 
there is a decomposition Tm\n = ^^\n ® ^-^in allowing us to reconstruct the 
superadditive category Trn\n from the additive category For example, for 
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M, € J^rn\n ^^^^ i > 0, we have that 

ExtV (M,iV)o = Ext^o {M~^,N^)(BExty, {UM\UN'), (4.45) 

' m\n m I n 

Ext>-^lJM,A^)i = Ext!^o (M°,nA^^) eExt!^o {nM^,N^). (4.46) 



At this point, we refer the reader to fCPSlj , |CPS2 | for the definition of a highest 
weight category with duality. 

Theorem 4.47. The category J~^^^ is a highest weight category with weight 
poset {X~^{m\n),^) and duality t. For A G X~^{m\n), U{X), P{X), K{X) and 
L(A) are the indecomposable tilting, projective, standard and irreducible modules 
parametrized by \, respectively. 



Proof. We have seen in Theorem 4.37 that (-P(A) : K{fi)) 7^ =^ A ^ /i. Given 
this and ( |1.13 ) it is a routine matter to check that satisfies the axioms for 



a highest weight category with duahty. □ 
Remark 4.48. In an entirely similar fashion, we define , to be the full 

' m\n 

subcategory of Omln consisting of the objects M all of whose composition factors 
are ~ -^^(A) for A G X{m\n). Using Theorem 4.3l| (ii) and the refined versions 



of (|4.9| ) and BGG reciprocity |B2| , (6.6)] keeping track of parity, one can prove 
analogues of all the results in this subsection for Oj^j^: there is a decomposition 

Cm|n = (^m\n®^^m\n^ ^""^ ^m|n * highest Weight Category with weight poset 
{X{m\n), :<) and duality r. 



§4-f. Kazhdan-Lusztig polynomials. In this subsection, we explain the true 
significance of the polynomials /^,a('?) = ^^Jxil) foi' l^i ^ ^ X~^(m\n). 

Lemma 4.49. Let /i € X^{m\n). Then, K(n) has a projective resolution 
• • • — > -Pi(/i) -fb(/^) ~^ K{fi) in such that for every A G X^{m\n), 

5^dimHom^„,„(P,(/z),L(A))(?^ = If^A-Q'')- 

i>0 

Proof. We first explain how to construct for fixed d > an exact sequence 
PdifJ-) PoifJ-) — > — > with each Pi(/x) projective. In case i^/j, = 0, 

K{ij,) is already projective, so we can simply take Po{fJ,) = K{pL) and -Pi(/i) = 
for i > 0. Now suppose > 0. Let g = f^ and apply Procedure p.23| to 
construct h = f^ and operators Xa^Ya G {Ea, Fa}aez- Since Procedure |3.23| 
reduces ^ to a typical weight in finitely many steps, we may assume inductively 
that we have already constructed an exact sequence 

Pd{iy) ^ . . . ^ Po{u) K{v) 0. (4.50) 

Now we consider two cases. Suppose first that jj^u = Then XaK{v) ~ 

K(fj,), so applying Xa to ( 4.50| ) gives us the desired sequence with Pi{fi) 



XaPi{iy). In the second case, #1^ = 1, and XaK{iy) has a two step filtration 
with K{fi) at the top and K{Xa{i')) at the bottom. Applying Xa to ( [4.50D gives 
us an exact sequence XaPd{i^) —>■■■■ ^ XaPoii^) XaK{u) —i- 0. By induction 
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on d, we may assume in addition that we have aheady constructed an exact 
sequence Pd-i{Xa{u)) ^ ••• ^ Po(la(i/)) ^ K{Xa{iy)) ^ 0. Applying the 
comparison theorem 2.2.6] to the embedding i : K{Xa{'^)) ^ XaK{i'), we 
get vertical maps making the diagram commute: 

■■• > Pl{Xa{v)) . Po(^aM) > K{Xa{u)) > 



XaPi{y) 



XaPo{y) 



XaK{v) 







The total complex of this double complex is exact by the acyclic assembly 
lemma [W, 2.7.3]. Factoring out K{Xa{lj)) yields the required exact sequence 

. . . ^ XaPi{y) e P^iXaiy)) XMv) K{fi) 

This time, Piifi) = XaPi{u) Pi-i{Xa{v)). 

Replacing d by (d + 1), the same procedure constructs an exact sequence 
Pd+i{fJ.) — > PdifJ-) PoilJ') — > K{fj.) — > 0, where we can always ensure 

that the first d terms are the same as the ones constructed before. Now letting 
d — >■ c» we get a projective resolution of K{n). We note moreover by the 
construction that whenever P{X) is a summand of Pi{n) for some i > 0, i.e. 
Homjr^l^ (Pj(^), L(A)) ^ 0, we must have that fj. ^ X. 

Finally let p^,x{q) = X]i>o dimHomjr^|^^(Pi(^), L(A))g\ To complete the 
proof, we need to show that Pfi^\{q) = lfi,xi—q~^) for each /i, A G X+(m|n). 
For this, we show that the polynomials p^^x{q) satisfy the same relations as the 
polynomials ^^,a(~9~^) in Lemma 3.24, Once this is established, the algorithm 
explained at the end of |§3-e to compute l^^\{—q~^) also computes p^^\{q), hence 
PpL,\{l) = l'fi,\{—q~^)- So take A,/i G X+(m]n) with > 0, where we may 
assume that wt(A) = wt(/i) since otherwise Pf_i,x{q) = and the conclusion holds 
trivially. Apply Procedure |3.25 to (7 = to get h = and operators Xa,Ya, 
and consider the two cases = #^ or = #fj. — 1, just like above. Let us 
just explain the argument in the second case, the first case being easier. Since 
wt(A) = wt(fi) and fi is not at the end of an a-string of length 2 in the dual 



crystal graph. Theorem 4.36 shows that l^L(A) equals L(Y*{X)), interpreted 
as if Y*{X) = 0. So we get that 



J^dimHom^„lJX,Pi(i.),L(A))g^ = ^ dimHom^„l„(Pi(z.), y„L(A))(7^ 

= J]dimHom^^lJP,(i.),L(y;(A)))g^ =p^^^^,(,)(g). 



i>0 



i>0 



interpreted as in case Y*{X) = 0. We noted above that = XaPi{y) 

Pi-iiXaiv))-, hence we get that Pn,x{q) = Py y*(x) 1PXaM,x(l)^ which is 
what we wanted in this case, cf. Lemma ^.24 . 



□ 



Now choose a length function on 
X+{m\n) by setting ^(A) := £{fx). 



yTn\n 



as explained in §3-g, and lift it to 
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Theorem 4.51. For /i, A G X^{m\n), the superspace Ext^^|^(i^(/i), L(A)) is 



concentrated in degree 0, and 

5]dimExtV^,Ji^(/.),L(A))g* 



i>0 



Hence, ExtV 



{K{^), L{X)) 7^ if and only if fJ. ^ X, in which case 

(i) Exty^^jK{fi),L{X))^O^i<i{X)-£{^x),i = e{X)-i{fi) (mod2); 

(ii) Ext5^^"^^^^(i^(/i),L(A)) is exactly one dimensional; 

(iii) Ext;^ ^ L(A)) is at most one dimensional. 

Proof. Apply the functor HomjF^|^^ (?, L(A)) to the projective resolution con 
structed in Lemma [4.49| and use Corollaries p. 45 , 3.39| (ii) and [4.44 



By |Z|, Theorem 7.6], Theorem 4.51 shows that the polynomials lfj.,\{—q^^) 
defined here agree with the Kazhdan-Lusztig polynomials K\^^{q) defined by 
Serganova in (It also proves pZl Conjecture 4.4], and answers a ques- 



tion raised at the end of Q.) Thus we have a cohomological interpretation of 
the polynomial Z^^a(— 9"^)) analogous to Vogan's interpretation |0, Conjecture 
3.4] of Kazhdan-Lusztig polynomials in category O for a semisimple Lie algebra. 



The even-odd vanishing established in Theorem 4.51 (i) is especially important: 



in the language of | CPS3 |, it shows that the highest weight category has a 
"Kazhdan-Lusztig theory" . Applying |CPS4 , Corollary 3.9] (and Corollary 4.44 
again), we obtain: 

Corollary 4.52. For /i, A € X^{m\n), the superspace Ext^ ^ (L(/z),L(A)) is 
concentrated in degree Q, and 



j>0 



dimExtV^, (L(^),L(A))g^ 



In particular, Ext^ ^ (L(/x),L(A)) ^ 



ueX+{m\n) 

^ i = i{X) - £{fi) (mod 2). 



Example 4.53. Take /x = A = and let r = min(m,n). In this case, the 



polynomials li,^^{—q~^) are computed explicitly in Example p. 37 . Combining 
this with Corollary 4.52| , one deduces that dimExt3?^|^(C, C) equals the number 
of partitions of i with at most r non-zero parts. Hence: 

1 



^dimExtV^lJCqg' 



i>0 



{l-q'){l-q^)...{l-q 



2t\ 



(4.54) 
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